-- Logs begin at Mon 2022-07-25 08:49:32 UTC, end at Mon 2022-07-25 10:04:01 UTC. -- Jul 25 09:31:36.686718 dv-osbrick-709432-11-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 09:31:36.697639 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 09:31:36 2022] *** Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: nodename: dv-osbrick-709432-11-ceph Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: machine: x86_64 Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: clock source: unix Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: pcre jit disabled Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: detected number of CPU cores: 4 Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: current working directory: / Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: detected binary path: /usr/bin/uwsgi-core Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: your processes number limit is 47680 Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: your memory page size is 4096 bytes Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: detected max file descriptor number: 2048 Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: lock engine: pthread robust mutexes Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: thunder lock: enabled Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 09:31:36.700973 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 09:31:36.743417 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: Python main interpreter initialized at 0x5564106479c0 Jul 25 09:31:36.743417 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: python threads support enabled Jul 25 09:31:36.743417 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: your server socket listen backlog is limited to 100 connections Jul 25 09:31:36.743417 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: your mercy for graceful operations on workers is 90 seconds Jul 25 09:31:36.743800 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 09:31:36.743878 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: *** Operational MODE: preforking *** Jul 25 09:31:36.744091 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: *** uWSGI is running in multiple interpreter mode *** Jul 25 09:31:36.744091 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: spawned uWSGI master process (pid: 93873) Jul 25 09:31:36.744298 dv-osbrick-709432-11-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 09:31:36.746516 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: spawned uWSGI worker 1 (pid: 93887, cores: 1) Jul 25 09:31:36.746516 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: spawned uWSGI worker 2 (pid: 93888, cores: 1) Jul 25 09:31:36.746516 dv-osbrick-709432-11-ceph devstack@keystone.service[93873]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 09:31:42.590622 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 09:31:42.590622 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: from cryptography.utils import int_from_bytes Jul 25 09:31:42.591422 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 09:31:42.591422 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: from cryptography.utils import int_from_bytes Jul 25 09:31:42.591834 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 09:31:42.591834 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: from cryptography.utils import int_from_bytes Jul 25 09:31:42.591942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 09:31:42.591942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: from cryptography.utils import int_from_bytes Jul 25 09:31:42.650108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 09:31:42.650300 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 09:31:42.650379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 09:31:42.650509 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] command line args: [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 09:31:42.650644 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 09:31:42.650729 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] command line args: [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 09:31:42.650797 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 09:31:42.650944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ================================================================================ {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 09:31:42.651033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 09:31:42.651113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ================================================================================ {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 09:31:42.651196 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] admin_token = **** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.651371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] admin_token = **** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.651459 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] config_dir = [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.651608 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.651689 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] config_dir = [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.651812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.651890 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] config_source = [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.651976 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] config_source = [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.652053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] debug = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.652164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] debug = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.652252 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.652455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.652607 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.652691 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.652758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.652825 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653084 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653251 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653330 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653480 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] list_limit = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] list_limit = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] log_config_append = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653765 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] log_config_append = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.653894 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654012 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] log_dir = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] log_dir = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] log_file = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654271 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] log_file = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654415 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654523 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.654944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655037 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655617 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655700 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.655903 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656099 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656376 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656482 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656849 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.656931 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.657008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.657184 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.657320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.657426 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.657576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.657688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.657792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658420 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] publish_errors = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] publish_errors = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658691 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658816 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.658980 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.659053 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.659233 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.659332 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.659470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.659555 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.660244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] standard_threads = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.660339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] standard_threads = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.660478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.660594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.660726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.660863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.660947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661100 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661180 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] use_journal = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] use_journal = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] use_json = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661437 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] use_json = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] use_stderr = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661627 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] use_stderr = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661701 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] use_syslog = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661778 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] use_syslog = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.661936 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.662015 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 09:31:42.662194 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.662284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.662436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.662537 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.662724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.662813 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.662968 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.663056 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.663222 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.663301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.663460 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.663537 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.663712 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.663800 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.663949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.664033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.664200 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.664278 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.664452 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.664545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.664712 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.664798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.664952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.665037 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.665200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.665287 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.665440 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.665528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.665691 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.665770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.665942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.666032 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.666182 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.666267 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.666441 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.666539 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.666728 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.666815 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.666976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.667054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.667215 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.667293 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.667471 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.667552 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.667735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.667814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.667990 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.668074 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.668241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.668319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.668476 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.668553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.668713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.668791 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.668945 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669024 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669184 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669267 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669519 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669685 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669918 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.669998 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.670153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.670236 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.670402 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.670518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.670691 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.670771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.670934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671187 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671270 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671658 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.671976 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.672128 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.672210 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.672361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.672439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.672592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.672678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.672825 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.672911 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.673062 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.673146 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.673312 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.673407 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.673544 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.673624 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.673781 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.673862 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.674014 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.674100 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.674249 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.674328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.674516 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.674633 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.674768 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.674863 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.675005 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.675091 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.675248 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.675330 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.676057 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.676152 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.676354 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.676433 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.676596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.676676 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.676838 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.676929 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.677074 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.677154 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.677349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.677481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.677558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.677639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.677798 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.677878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.678033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.678124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.678299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.678387 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.678561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.678645 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.678800 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.678890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.679042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.679201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.679279 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.679351 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.679539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.679619 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.679780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.679868 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.680034 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.680119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.680279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.680358 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.680522 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.680620 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.680763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.680858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681252 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681332 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681584 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681732 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.681977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.682064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.682214 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.682302 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.682454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.682597 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.682713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.682801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.682952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.683034 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.683189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.683276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.683452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.683531 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.683692 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.683773 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.683934 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684013 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684168 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684248 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684411 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684647 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684884 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.684969 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.685117 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.685204 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.685350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.685431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.685581 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.685664 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.685809 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.685891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.686047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.686126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.686275 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.686360 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.686536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.686622 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.686779 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.686857 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.687027 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.687108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.687265 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.687345 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.687520 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.687599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.687785 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.687872 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.688030 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.688110 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.688262 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] auth.external = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.688341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] auth.external = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.688496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.688575 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.688793 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.688902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689029 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689260 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] auth.password = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689340 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] auth.password = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689494 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] auth.token = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] auth.token = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.689973 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.690053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.690223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.690309 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.690514 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.690600 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.690739 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.690821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.691027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.691116 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.691263 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.691347 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.691521 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] credential.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.691653 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] credential.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.691757 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.691836 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692009 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692090 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692259 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692500 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692740 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692820 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.692977 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.693058 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.693248 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.693328 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.693505 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.693587 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.693746 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.693833 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.694003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.694092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.694285 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.694372 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.694556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.694651 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.694824 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.694906 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.695069 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.695149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.695326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.695406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.695564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] federation.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.695643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] federation.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.695799 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.695881 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.696049 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.696128 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.696295 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.696375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.696526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.696609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.696775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.696856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697012 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697100 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697343 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697499 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697581 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.697993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.698074 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.698236 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.698314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.698502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.698598 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.698753 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.698835 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699239 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699557 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699805 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.699959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.700051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.700196 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.700276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.700449 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.700530 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.700703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.700792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.700938 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701019 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701251 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701731 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701901 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.701986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.702153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.702241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.702415 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.702516 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.702694 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.702774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.702969 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.703062 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.703211 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.703291 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.703448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.703533 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.703683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.703771 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.703920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704152 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704631 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704710 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.704950 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.705123 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.705212 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.705357 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.705439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.705607 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.705688 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.705857 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.705940 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.706096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.706176 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.706343 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.706423 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.706640 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.706729 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.706883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.707010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.707113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.707195 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.707345 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.707428 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.707586 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.707666 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.708084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.708171 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.708331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.708413 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.708569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.708649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.708807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.708895 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.709061 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.709142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.709310 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.709390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.709544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.709625 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.709778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.709860 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.710030 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.710111 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.710281 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.710362 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.710541 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.710638 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.710782 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.710864 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711022 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711251 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711332 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711492 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711757 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.711991 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.712073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.712243 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.712322 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.712495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.712576 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.712746 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.712827 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.712981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.713060 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.713212 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.713293 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.713449 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.713535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.713686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.713765 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.713921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.714000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.714152 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.714235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.714401 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.714504 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.714673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.714754 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.714922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.715005 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.715170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.715252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.715419 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.715500 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.715650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.715732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.715898 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716019 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716137 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716218 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716374 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716688 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716845 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.716925 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.717080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.717156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.717332 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.717414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.717570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.717649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.717827 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.717908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.718059 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.718141 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.718304 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.718385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.718564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.718649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.718803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.718883 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.719041 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.719120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.719289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.719371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.719535 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.719617 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.719771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.719850 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720250 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] resource.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720329 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] resource.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720754 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720834 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.720991 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.721070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.721244 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.721323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.721491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.721573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.721729 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.721808 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.721978 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.722066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.722791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.722912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.723087 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.723175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.723326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] role.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.723420 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] role.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.723579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] role.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.723662 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] role.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.723813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.723894 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.724063 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.724151 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.724315 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.724398 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.724567 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.724648 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.724834 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.724930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.725073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.725155 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.725331 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.725410 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.725582 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.725670 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.725835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.725915 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.726067 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.726146 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.726318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.726410 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.726589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.726672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.726843 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.726923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.727093 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.727185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.727488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.727568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.727724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.727803 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.727978 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.728074 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.728232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.728314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.728485 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.728564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.728734 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.728816 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.728971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.729053 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.729227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.729308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.729481 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.729564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.729731 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.729810 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.729966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.730045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.730199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.730280 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.730429 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.730530 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.730707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.730788 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.730967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.731051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.731217 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.731296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.731454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.731533 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.731694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.731775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.731930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732009 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732169 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] token.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] token.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732406 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732487 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732658 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732900 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.732979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.733159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.733242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.733412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.733493 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.733650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.733731 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.733896 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.733978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.734142 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.734222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.734390 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.734498 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.734654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.734738 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.734893 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.734973 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.735131 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.735210 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.735379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.735460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.735630 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.735710 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.735861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.735940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.736102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.736183 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.736394 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.736475 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.736657 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.connection = **** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.736747 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.connection = **** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.736903 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.736993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.737152 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.737316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.737395 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.737468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.737621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.737703 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.738419 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.738541 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.738768 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.738849 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.739010 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.739092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.739275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.739363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.739528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.739609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.739790 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.739870 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.740039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.740128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.740269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.740389 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.740525 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.740608 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.740764 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.740852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741093 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741241 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741321 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741482 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741571 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741722 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 09:31:42.741875 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 09:31:42.741947 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 09:31:42.771455 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.771615 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.771698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.771774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.771902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.771990 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.780518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.780727 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.811432 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.811661 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.811749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.811906 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.865490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.865781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.914988 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.915219 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.916092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.916332 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.983208 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.983447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.983544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.983676 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.983763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.983896 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.983981 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.984115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.984198 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.984332 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.984417 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:42.984549 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.007576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.007813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.007915 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008044 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008355 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008517 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008822 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.008955 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.009048 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.009171 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.020494 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.020831 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.033136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.033369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.033587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.033673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.033808 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.033892 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.034026 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.034119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.034241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.034325 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.034454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93888) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.034553 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.034827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.035204 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93887) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 09:31:43.052478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.052688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 09:31:43.052879 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.053027 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.053126 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 09:31:43.053233 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 09:31:43.053418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.053501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.053621 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 09:31:43.053753 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.053891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.054011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.054150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.054268 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.054426 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.054719 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.065385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.065668 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.065902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.066004 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.066215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.066343 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.066589 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.066800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.074397 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.075153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.077728 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.078009 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.078289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.078544 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.078664 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.078826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.078943 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.079110 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.079193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.079396 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.079487 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.079682 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.079818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.079944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.080091 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.080215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.080364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.080599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.080680 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.080875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.081174 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.081467 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.109073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.109578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.110729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.111011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.111246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.111550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.118310 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.118567 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.118698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.118851 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.118978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.119262 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.126191 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.126492 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.126660 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.126946 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.131055 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.131339 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.131541 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.131627 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.131828 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.131913 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.132111 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.132257 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.132393 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.132535 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.132785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.132868 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.133063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.133144 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.133335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.133606 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.152230 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.152510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.153063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.153342 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.157244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.158132 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.161656 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.161947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.162649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.162947 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.167097 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.168016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.170783 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.171725 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.174413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.174734 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.175034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.175474 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.175567 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.175787 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.175905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.176077 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.176198 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.176478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.176764 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.177049 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.195250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.195532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.195802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.196066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.196406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.196692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.196961 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.197222 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.204174 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.205375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.205964 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.206246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.207724 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.208261 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.210183 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.210477 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.210778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.211076 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.211356 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.211451 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.211665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.211949 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.212252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.212542 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.225442 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.225686 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.225982 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.226263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.226569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.226780 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.226865 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.227060 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.227144 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.227349 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.227631 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.227912 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.228188 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.228465 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.245032 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.246669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.248464 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.250148 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.251831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.253481 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.253604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.255166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.255347 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.255458 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.255745 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.257030 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.257308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.257589 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.263222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.264854 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.265182 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.266873 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.268296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.268589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.268873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.269754 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.270833 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.271128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.271434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.271710 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.278945 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.279231 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.279508 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.280951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.281244 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.281529 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.287660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93888) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.287940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.288220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.288494 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.288773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.289043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.289332 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.289601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.289794 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93887) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 09:31:43.289878 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.290109 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.290199 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.290394 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.290495 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.290690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.290772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.290955 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.291099 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.291227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.291309 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93888) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.291516 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.291783 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.292066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.292335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.292614 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.292885 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.293169 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.293454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93887) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 09:31:43.329937 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5564106479c0 pid: 93888 (default app) Jul 25 09:31:43.333199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5564106479c0 pid: 93887 (default app) Jul 25 09:31:43.334050 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83dd17-3df3-420c-afa2-a900d5b84be0 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:43.334345 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83dd17-3df3-420c-afa2-a900d5b84be0 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:43.334650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83dd17-3df3-420c-afa2-a900d5b84be0 None None] PATH_INFO: `/v3` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:43.338981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Mon Jul 25 09:31:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:31:52.419634 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e499-01e7-4233-8208-d6eea824c556 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:52.420153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e499-01e7-4233-8208-d6eea824c556 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:52.420240 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e499-01e7-4233-8208-d6eea824c556 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:52.424606 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:31:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:31:52.430417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:52.430846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:52.431005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:52.606641 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: INFO dbcounter [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] Registered counter for database keystone Jul 25 09:31:52.628031 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG oslo_db.sqlalchemy.engines [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 09:31:52.634150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writer thread running {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 09:31:52.813424 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG passlib.handlers.bcrypt [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93888) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 09:31:52.813850 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG passlib.handlers.bcrypt [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93888) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 09:31:52.870547 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:31:52.872125 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:31:52.999440 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:31:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 09:31:53.162392 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e499-01e7-4233-8208-d6eea824c556 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:53.343141 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: INFO dbcounter [None req-ae47e499-01e7-4233-8208-d6eea824c556 None None] Registered counter for database keystone Jul 25 09:31:53.364006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG oslo_db.sqlalchemy.engines [None req-ae47e499-01e7-4233-8208-d6eea824c556 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 09:31:53.370400 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writer thread running {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 09:31:53.491398 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e499-01e7-4233-8208-d6eea824c556 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:53.495748 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3076ad-06a1-496a-8a6b-26fa4497255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:53.496424 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3076ad-06a1-496a-8a6b-26fa4497255a admin admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:53.496712 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3076ad-06a1-496a-8a6b-26fa4497255a admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:53.496993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3076ad-06a1-496a-8a6b-26fa4497255a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:53.506125 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3076ad-06a1-496a-8a6b-26fa4497255a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:53.557687 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9d3076ad-06a1-496a-8a6b-26fa4497255a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 09:31:53.558031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3076ad-06a1-496a-8a6b-26fa4497255a admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:53.568309 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Mon Jul 25 09:31:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 09:31:53.574458 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:53.590479 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39452a-60e0-4d89-81af-77a542249b85 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:53.594988 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbda547-d9c3-4cbe-8cd8-04e972b008cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:53.596236 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda547-d9c3-4cbe-8cd8-04e972b008cc admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:53.596532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda547-d9c3-4cbe-8cd8-04e972b008cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:53.597041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbda547-d9c3-4cbe-8cd8-04e972b008cc admin admin] PATH_INFO: `/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:53.598609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbda547-d9c3-4cbe-8cd8-04e972b008cc admin admin] RBAC: Authorizing `identity:get_project(project_id=81ad3fb6bc2540d4880f089b3fb44ef8)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:53.651851 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7dbda547-d9c3-4cbe-8cd8-04e972b008cc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 09:31:53.652197 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbda547-d9c3-4cbe-8cd8-04e972b008cc admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:53.656832 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Mon Jul 25 09:31:53 2022] GET /identity/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:31:55.877466 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c17d-7355-4fb0-934d-6bc6cacc6b33 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:55.878056 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c17d-7355-4fb0-934d-6bc6cacc6b33 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:55.878225 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2c17d-7355-4fb0-934d-6bc6cacc6b33 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:55.882991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:31:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:31:55.888650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2b313-a004-4cf7-b992-eabecc762c53 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:55.889090 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2b313-a004-4cf7-b992-eabecc762c53 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:55.889214 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2b313-a004-4cf7-b992-eabecc762c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:55.913624 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-c0f2b313-a004-4cf7-b992-eabecc762c53 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:31:55.917183 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-c0f2b313-a004-4cf7-b992-eabecc762c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:31:55.926100 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:31:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 09:31:55.950979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2c17d-7355-4fb0-934d-6bc6cacc6b33 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:55.965449 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2c17d-7355-4fb0-934d-6bc6cacc6b33 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:55.969684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99334d-dd99-4d53-af22-a324b5939a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:55.970318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99334d-dd99-4d53-af22-a324b5939a07 admin admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:55.970814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99334d-dd99-4d53-af22-a324b5939a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:55.971311 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99334d-dd99-4d53-af22-a324b5939a07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:55.980459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99334d-dd99-4d53-af22-a324b5939a07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:55.982349 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99334d-dd99-4d53-af22-a324b5939a07 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:55.996455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Mon Jul 25 09:31:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 09:31:56.002193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2b313-a004-4cf7-b992-eabecc762c53 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:56.011808 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2b313-a004-4cf7-b992-eabecc762c53 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:56.016285 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16db9b7-a7d7-403e-a240-ad68cc8a9706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:56.017147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db9b7-a7d7-403e-a240-ad68cc8a9706 admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:56.017428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db9b7-a7d7-403e-a240-ad68cc8a9706 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:56.017703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16db9b7-a7d7-403e-a240-ad68cc8a9706 admin admin] PATH_INFO: `/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:56.019411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db9b7-a7d7-403e-a240-ad68cc8a9706 admin admin] RBAC: Authorizing `identity:get_user(user_id=c2c0cf22337e45c78e8cb5635c37dbcb)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:56.021695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16db9b7-a7d7-403e-a240-ad68cc8a9706 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:56.023332 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Mon Jul 25 09:31:56 2022] GET /identity/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:31:58.349202 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7111f6-7cdc-4e94-8bea-fc3c08e03111 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:58.349658 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7111f6-7cdc-4e94-8bea-fc3c08e03111 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:58.349774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7111f6-7cdc-4e94-8bea-fc3c08e03111 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:58.351149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:31:58.356394 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe76fdb-cb20-4520-966a-33e58ae4d628 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:58.356767 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe76fdb-cb20-4520-966a-33e58ae4d628 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:58.356962 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe76fdb-cb20-4520-966a-33e58ae4d628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:58.375297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-3fe76fdb-cb20-4520-966a-33e58ae4d628 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:31:58.376464 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-3fe76fdb-cb20-4520-966a-33e58ae4d628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:31:58.397786 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c03c0-a2c5-4817-b0cf-d06179f0a586 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:58.398075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c03c0-a2c5-4817-b0cf-d06179f0a586 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:58.398357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c03c0-a2c5-4817-b0cf-d06179f0a586 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:58.399735 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:31:58.404762 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:58.405055 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:58.405339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:58.449532 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG passlib.handlers.bcrypt [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93887) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 09:31:58.449945 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG passlib.handlers.bcrypt [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93887) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 09:31:58.459345 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:31:58.483475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe76fdb-cb20-4520-966a-33e58ae4d628 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:58.495784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:31:58.497370 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:31:58.507951 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:31:58.588543 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe76fdb-cb20-4520-966a-33e58ae4d628 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:58.596604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:31:58.620684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:58.623446 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529a5d7-490f-4e52-8336-a4d8e37f36d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:58.624254 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a5d7-490f-4e52-8336-a4d8e37f36d5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:58.624547 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a5d7-490f-4e52-8336-a4d8e37f36d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:58.624833 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529a5d7-490f-4e52-8336-a4d8e37f36d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:58.637366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529a5d7-490f-4e52-8336-a4d8e37f36d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-2529a5d7-490f-4e52-8336-a4d8e37f36d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:31:58.648855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:31:58.649904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:31:58.650888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:31:58.655989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529a5d7-490f-4e52-8336-a4d8e37f36d5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:58.724219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d6ca1-35dc-43a2-a159-6c17043c4a15 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:58.726524 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:31:58.740484 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:31:58.758053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529a5d7-490f-4e52-8336-a4d8e37f36d5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:58.765466 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299add6-773d-49b1-8fa8-c56768527258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:58.766364 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299add6-773d-49b1-8fa8-c56768527258 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:58.766689 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299add6-773d-49b1-8fa8-c56768527258 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:58.766978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299add6-773d-49b1-8fa8-c56768527258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:58.792218 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:58.792890 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:58.793182 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:58.793467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:58.794264 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:31:58.794617 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:58.796039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:58.808934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:31:58.814666 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:58.838162 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299add6-773d-49b1-8fa8-c56768527258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:58.839791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299add6-773d-49b1-8fa8-c56768527258 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:58.916038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96145e65-8a90-470e-8791-8f066fefaac2 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:58.939364 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 09:31:58.945075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299add6-773d-49b1-8fa8-c56768527258 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:58.947808 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:31:58.951136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528115d8-fc71-4f30-921f-a880bffbed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:58.952013 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528115d8-fc71-4f30-921f-a880bffbed3f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:58.952290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528115d8-fc71-4f30-921f-a880bffbed3f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:58.952564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528115d8-fc71-4f30-921f-a880bffbed3f None admin] PATH_INFO: `/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:58.953830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528115d8-fc71-4f30-921f-a880bffbed3f None admin] RBAC: Authorizing `identity:get_user(user_id=c2c0cf22337e45c78e8cb5635c37dbcb)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:58.955302 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528115d8-fc71-4f30-921f-a880bffbed3f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:58.957033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:31:58 2022] GET /identity/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:31:58.962893 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528115d8-fc71-4f30-921f-a880bffbed3f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:58.977778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:31:59.044055 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299add6-773d-49b1-8fa8-c56768527258 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:59.061528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528115d8-fc71-4f30-921f-a880bffbed3f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:59.077513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:59.078411 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:59.078810 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:59.079164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:59.096190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876cb2-cbdf-4e83-8eaa-2521052274e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:59.098095 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876cb2-cbdf-4e83-8eaa-2521052274e9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:59.098381 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876cb2-cbdf-4e83-8eaa-2521052274e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:59.098695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876cb2-cbdf-4e83-8eaa-2521052274e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:59.099851 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:59.100074 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7876cb2-cbdf-4e83-8eaa-2521052274e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:59.101340 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:59.101534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7876cb2-cbdf-4e83-8eaa-2521052274e9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:59.103340 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 10/18] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:31:59.108929 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876cb2-cbdf-4e83-8eaa-2521052274e9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:31:59.123161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:31:59.124105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:31:59.124899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:31:59.124899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:31:59.124899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:31:59.124899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:31:59.124899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 9/19] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:31:59.130430 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:31:59.186870 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:31:59.194027 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:31:59.214033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876cb2-cbdf-4e83-8eaa-2521052274e9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:59.230659 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3d0cd-c33b-4483-8740-21f40754aa1f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:31:59.248771 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430ee15-933d-4b84-acd7-9765d8e2e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:59.249435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ee15-933d-4b84-acd7-9765d8e2e205 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:59.249725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ee15-933d-4b84-acd7-9765d8e2e205 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:59.250005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ee15-933d-4b84-acd7-9765d8e2e205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:59.250875 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430ee15-933d-4b84-acd7-9765d8e2e205 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.domain.id=default, user.id=c2c0cf22337e45c78e8cb5635c37dbcb) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:31:59.251198 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430ee15-933d-4b84-acd7-9765d8e2e205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:59.252677 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430ee15-933d-4b84-acd7-9765d8e2e205 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:59.260165 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 11/20] 10.222.0.67 () {56 vars in 1322 bytes} [Mon Jul 25 09:31:59 2022] GET /identity/v3/role_assignments?user.id=c2c0cf22337e45c78e8cb5635c37dbcb&scope.domain.id=default&role.id=bd8b88fae376413398183761500b2e1d => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:31:59.266001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7e537-378b-46ad-a6c7-6ad752b65168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:31:59.266742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e537-378b-46ad-a6c7-6ad752b65168 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:31:59.267036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e537-378b-46ad-a6c7-6ad752b65168 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:31:59.267320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7e537-378b-46ad-a6c7-6ad752b65168 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:31:59.268077 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7e537-378b-46ad-a6c7-6ad752b65168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:31:59.268390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7e537-378b-46ad-a6c7-6ad752b65168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:31:59.270243 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7e537-378b-46ad-a6c7-6ad752b65168 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:31:59.292278 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 10/21] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:01.785198 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb4b1b-3c54-4d1c-a9eb-dc6482cd070e None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:01.786250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb4b1b-3c54-4d1c-a9eb-dc6482cd070e None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:01.786792 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb4b1b-3c54-4d1c-a9eb-dc6482cd070e None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:01.788368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 12/22] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:01.794175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeffc70-1bb4-4455-b968-6bd32190def3 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:01.794632 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeffc70-1bb4-4455-b968-6bd32190def3 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:01.794755 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeffc70-1bb4-4455-b968-6bd32190def3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:01.823588 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-9eeffc70-1bb4-4455-b968-6bd32190def3 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:01.824803 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-9eeffc70-1bb4-4455-b968-6bd32190def3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:01.862097 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffacd8-3c42-4a59-b6b3-2d948629202c None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:01.862829 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffacd8-3c42-4a59-b6b3-2d948629202c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:01.863539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffacd8-3c42-4a59-b6b3-2d948629202c None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:01.865574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 13/23] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:01.872471 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1d0c5-abdd-467f-b883-f7c823b6af10 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:01.873094 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1d0c5-abdd-467f-b883-f7c823b6af10 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:01.873581 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1d0c5-abdd-467f-b883-f7c823b6af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:01.903508 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-ecd1d0c5-abdd-467f-b883-f7c823b6af10 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:01.905067 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-ecd1d0c5-abdd-467f-b883-f7c823b6af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:01.936885 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 11/24] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:01.975525 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeffc70-1bb4-4455-b968-6bd32190def3 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:02.040884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 14/25] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:02.049557 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1eb86-f1dd-4768-9e16-ae3f9eff06bd None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:02.050876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1eb86-f1dd-4768-9e16-ae3f9eff06bd None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:02.051298 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1eb86-f1dd-4768-9e16-ae3f9eff06bd None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:02.052960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 15/26] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:32:02.054800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:02.063780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f02b-4bcd-4b27-a045-f233710a0dd7 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:02.064115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f02b-4bcd-4b27-a045-f233710a0dd7 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:02.064398 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f02b-4bcd-4b27-a045-f233710a0dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:02.108227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-34c5f02b-4bcd-4b27-a045-f233710a0dd7 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:02.109650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-34c5f02b-4bcd-4b27-a045-f233710a0dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:02.127278 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeffc70-1bb4-4455-b968-6bd32190def3 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:02.166368 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa1685-7b2d-4f7c-819f-67f16e24ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:02.167565 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1685-7b2d-4f7c-819f-67f16e24ee16 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:02.168765 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1685-7b2d-4f7c-819f-67f16e24ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:02.169826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1685-7b2d-4f7c-819f-67f16e24ee16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:02.195982 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa1685-7b2d-4f7c-819f-67f16e24ee16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1efa1685-7b2d-4f7c-819f-67f16e24ee16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:02.209185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:02.210045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:02.210926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 12/27] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:02.214492 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa1685-7b2d-4f7c-819f-67f16e24ee16 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:02.241213 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 16/28] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:02.242084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5f02b-4bcd-4b27-a045-f233710a0dd7 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:02.250958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:02.393718 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5f02b-4bcd-4b27-a045-f233710a0dd7 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:02.432478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:02.433433 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:02.433866 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:02.434287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:02.435232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:02.436132 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:02.437957 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:02.448247 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 17/29] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:02.449371 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:02.481070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa1685-7b2d-4f7c-819f-67f16e24ee16 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:02.494829 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:02.546306 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:02.547139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:02.547423 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:02.547700 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:02.567643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:02.569182 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:02.583223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:32:02.607197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:02.609254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:02.610382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:32:02.610382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:32:02.610382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:32:02.610382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:02.610382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 13/30] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:02.610382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:02.620279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8f27d-7917-4131-ac1a-4edcb86da2be None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:02.655866 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd79cdf-4636-4935-a6f0-049da70b06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:02.656546 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd79cdf-4636-4935-a6f0-049da70b06d4 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:02.656835 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd79cdf-4636-4935-a6f0-049da70b06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:02.657115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd79cdf-4636-4935-a6f0-049da70b06d4 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:02.657865 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd79cdf-4636-4935-a6f0-049da70b06d4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:02.660037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd79cdf-4636-4935-a6f0-049da70b06d4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:02.763987 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde55914-bf5c-4e5e-9534-d3c90a14ae3c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:02.806826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88edbcd-0c1b-4121-a8bc-48967d5b115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:02.808364 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edbcd-0c1b-4121-a8bc-48967d5b115c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:02.808801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edbcd-0c1b-4121-a8bc-48967d5b115c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:02.809227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88edbcd-0c1b-4121-a8bc-48967d5b115c None admin] PATH_INFO: `/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:02.811070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88edbcd-0c1b-4121-a8bc-48967d5b115c None admin] RBAC: Authorizing `identity:get_user(user_id=c2c0cf22337e45c78e8cb5635c37dbcb)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:02.812679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88edbcd-0c1b-4121-a8bc-48967d5b115c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:02.814903 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 14/31] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:02 2022] GET /identity/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:02.815874 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88edbcd-0c1b-4121-a8bc-48967d5b115c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:02.857375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:02.938595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88edbcd-0c1b-4121-a8bc-48967d5b115c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:02.952121 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 18/32] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Jul 25 09:32:02 2022] POST /identity/v3/roles => generated 219 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:02.954337 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57f65-2046-4a25-bb5e-62cf61d508e5 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:02.954859 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57f65-2046-4a25-bb5e-62cf61d508e5 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:02.955343 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57f65-2046-4a25-bb5e-62cf61d508e5 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:02.957229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 19/33] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:02.958618 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf57f65-2046-4a25-bb5e-62cf61d508e5 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:03.012491 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd669096-5256-4781-b4b9-86f3724636d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:03.013538 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd669096-5256-4781-b4b9-86f3724636d8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.014026 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd669096-5256-4781-b4b9-86f3724636d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.014809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd669096-5256-4781-b4b9-86f3724636d8 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.016228 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd669096-5256-4781-b4b9-86f3724636d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:03.016924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd669096-5256-4781-b4b9-86f3724636d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:03.020016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd669096-5256-4781-b4b9-86f3724636d8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:03.049308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 15/34] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:03.051908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab63e0-3018-4a98-aaef-b203bb55bcf2 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.052649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab63e0-3018-4a98-aaef-b203bb55bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.054581 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab63e0-3018-4a98-aaef-b203bb55bcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.083876 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-65ab63e0-3018-4a98-aaef-b203bb55bcf2 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:03.085451 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-65ab63e0-3018-4a98-aaef-b203bb55bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:03.181305 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf57f65-2046-4a25-bb5e-62cf61d508e5 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:03.209585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 16/35] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:03.210450 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab63e0-3018-4a98-aaef-b203bb55bcf2 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:03.224120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:03.242924 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8952ef-6689-49ac-8e75-968fe0dcf2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:03.243485 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8952ef-6689-49ac-8e75-968fe0dcf2f4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.243776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8952ef-6689-49ac-8e75-968fe0dcf2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.244059 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8952ef-6689-49ac-8e75-968fe0dcf2f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.246103 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8952ef-6689-49ac-8e75-968fe0dcf2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:03.248058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8952ef-6689-49ac-8e75-968fe0dcf2f4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:03.250011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 20/36] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:03.251659 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:03.255437 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8952ef-6689-49ac-8e75-968fe0dcf2f4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:03.353238 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab63e0-3018-4a98-aaef-b203bb55bcf2 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:03.403697 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08a1a9-715d-4234-a1a3-4a6862fcafdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:03.404847 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08a1a9-715d-4234-a1a3-4a6862fcafdb None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.404847 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08a1a9-715d-4234-a1a3-4a6862fcafdb None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.405115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08a1a9-715d-4234-a1a3-4a6862fcafdb None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.405842 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08a1a9-715d-4234-a1a3-4a6862fcafdb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:03.406956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8952ef-6689-49ac-8e75-968fe0dcf2f4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:03.407389 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08a1a9-715d-4234-a1a3-4a6862fcafdb None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:03.460726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7198bb-9ba3-4bb7-83ff-9488ddc5f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:03.460726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7198bb-9ba3-4bb7-83ff-9488ddc5f03e None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.460726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7198bb-9ba3-4bb7-83ff-9488ddc5f03e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.460726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7198bb-9ba3-4bb7-83ff-9488ddc5f03e None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.461189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7198bb-9ba3-4bb7-83ff-9488ddc5f03e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:03.461189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7198bb-9ba3-4bb7-83ff-9488ddc5f03e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:03.564916 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 21/37] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Jul 25 09:32:03 2022] POST /identity/v3/roles => generated 225 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:03.575488 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7198bb-9ba3-4bb7-83ff-9488ddc5f03e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:03.648658 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:03.659808 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 17/38] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:32:03 2022] POST /identity/v3/projects => generated 301 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:03.669401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e695e-d72c-4816-b407-36fbeca82509 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.669401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e695e-d72c-4816-b407-36fbeca82509 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.669401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e695e-d72c-4816-b407-36fbeca82509 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.670849 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 18/39] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:03.682443 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902b49-9418-454a-873a-2a76ca6e4445 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.682885 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902b49-9418-454a-873a-2a76ca6e4445 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.683143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902b49-9418-454a-873a-2a76ca6e4445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.708930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-c3902b49-9418-454a-873a-2a76ca6e4445 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:03.711006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-c3902b49-9418-454a-873a-2a76ca6e4445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:03.716364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7198bb-9ba3-4bb7-83ff-9488ddc5f03e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:03.780314 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243be47-86ff-4a6b-b685-9fd9fc9ba58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:03.781226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243be47-86ff-4a6b-b685-9fd9fc9ba58a None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.781518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243be47-86ff-4a6b-b685-9fd9fc9ba58a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.781819 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243be47-86ff-4a6b-b685-9fd9fc9ba58a None admin] PATH_INFO: `/v3/domains/default/users/c2c0cf22337e45c78e8cb5635c37dbcb/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.784069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243be47-86ff-4a6b-b685-9fd9fc9ba58a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c2c0cf22337e45c78e8cb5635c37dbcb, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:03.787884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243be47-86ff-4a6b-b685-9fd9fc9ba58a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:03.798813 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:03.806093 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 19/40] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 09:32:03.807835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8134ff-eb25-4f2a-9f1a-bad7f5ec3132 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.808832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8134ff-eb25-4f2a-9f1a-bad7f5ec3132 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.809265 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8134ff-eb25-4f2a-9f1a-bad7f5ec3132 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.810919 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 20/41] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:03.817586 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fc063-9169-4f42-8139-aa909a4bdfee None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:03.818150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fc063-9169-4f42-8139-aa909a4bdfee None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:03.818672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fc063-9169-4f42-8139-aa909a4bdfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:03.838459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-027fc063-9169-4f42-8139-aa909a4bdfee None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:03.839978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-027fc063-9169-4f42-8139-aa909a4bdfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:03.910171 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 21/42] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:03.911296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fc063-9169-4f42-8139-aa909a4bdfee None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:03.912967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 22/43] 10.222.0.67 () {58 vars in 1361 bytes} [Mon Jul 25 09:32:03 2022] PUT /identity/v3/domains/default/users/c2c0cf22337e45c78e8cb5635c37dbcb/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:03.935933 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243be47-86ff-4a6b-b685-9fd9fc9ba58a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:04.026930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fc063-9169-4f42-8139-aa909a4bdfee None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:04.057222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243be47-86ff-4a6b-b685-9fd9fc9ba58a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:04.058538 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:04.068486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ea816-c7d4-41d0-beac-23880c26a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:04.069308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ea816-c7d4-41d0-beac-23880c26a99e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:04.073564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ea816-c7d4-41d0-beac-23880c26a99e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:04.073564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ea816-c7d4-41d0-beac-23880c26a99e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:04.073564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ea816-c7d4-41d0-beac-23880c26a99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:04.073564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ea816-c7d4-41d0-beac-23880c26a99e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:04.074608 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 22/44] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:04.075397 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:04.083073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ea816-c7d4-41d0-beac-23880c26a99e None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:04.104869 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bc070-c346-474b-a3c7-4587ce30edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:04.105557 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bc070-c346-474b-a3c7-4587ce30edc5 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:04.105852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bc070-c346-474b-a3c7-4587ce30edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:04.106139 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bc070-c346-474b-a3c7-4587ce30edc5 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:04.106941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bc070-c346-474b-a3c7-4587ce30edc5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:04.108358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bc070-c346-474b-a3c7-4587ce30edc5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:04.176258 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 23/45] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Jul 25 09:32:03 2022] POST /identity/v3/roles => generated 223 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:32:04.195911 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ea816-c7d4-41d0-beac-23880c26a99e None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:04.235746 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d4086-f562-4548-a327-ad1f5eb229b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:04.236485 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d4086-f562-4548-a327-ad1f5eb229b7 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:04.236775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d4086-f562-4548-a327-ad1f5eb229b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:04.237944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d4086-f562-4548-a327-ad1f5eb229b7 None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:04.238753 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d4086-f562-4548-a327-ad1f5eb229b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:04.240305 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d4086-f562-4548-a327-ad1f5eb229b7 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:04.359804 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 23/46] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:32:04 2022] POST /identity/v3/projects => generated 312 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:32:06.176240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888806-2e83-4398-b2d0-f0bba784ce02 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.176757 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888806-2e83-4398-b2d0-f0bba784ce02 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.176875 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888806-2e83-4398-b2d0-f0bba784ce02 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.178169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 24/47] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:06.183288 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311dea8-27ea-49a7-89e8-1abf359d9957 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.183686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311dea8-27ea-49a7-89e8-1abf359d9957 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.183859 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311dea8-27ea-49a7-89e8-1abf359d9957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.202711 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-b311dea8-27ea-49a7-89e8-1abf359d9957 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:06.203896 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-b311dea8-27ea-49a7-89e8-1abf359d9957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:06.248242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:06.273766 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 24/48] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:06.298705 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888806-2e83-4398-b2d0-f0bba784ce02 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:06.401977 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888806-2e83-4398-b2d0-f0bba784ce02 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:06.437719 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfcdd0-f995-4d7a-803d-2348acaa609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:06.438443 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfcdd0-f995-4d7a-803d-2348acaa609d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.438764 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfcdd0-f995-4d7a-803d-2348acaa609d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.439050 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfcdd0-f995-4d7a-803d-2348acaa609d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.449805 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfcdd0-f995-4d7a-803d-2348acaa609d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-a7dfcdd0-f995-4d7a-803d-2348acaa609d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:06.458279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:06.459448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:06.460250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 25/49] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:06.465948 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311dea8-27ea-49a7-89e8-1abf359d9957 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:06.569458 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311dea8-27ea-49a7-89e8-1abf359d9957 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:06.604876 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:06.605549 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.605841 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.606131 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.606924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:06.607239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:06.608687 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:06.618189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23099-6d85-4e5b-8428-4d4dd9485bd5 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.618506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23099-6d85-4e5b-8428-4d4dd9485bd5 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.618800 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e23099-6d85-4e5b-8428-4d4dd9485bd5 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.620395 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 26/50] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:06.621424 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 25/51] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:06.625191 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f88e9-93ee-4f95-b7f9-633268b0052e None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.625507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f88e9-93ee-4f95-b7f9-633268b0052e None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.625793 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f88e9-93ee-4f95-b7f9-633268b0052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.627098 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:06.644739 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-059f88e9-93ee-4f95-b7f9-633268b0052e None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:06.646275 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-059f88e9-93ee-4f95-b7f9-633268b0052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:06.669439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:06.674485 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:06.716334 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 27/52] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:06.728407 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa53079-0e4c-4b22-9244-6853f3ad29a7 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:06.740711 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f88e9-93ee-4f95-b7f9-633268b0052e None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:06.765964 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291526f-e8f1-4759-9e60-beaf1a979291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:06.766895 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291526f-e8f1-4759-9e60-beaf1a979291 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.767187 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291526f-e8f1-4759-9e60-beaf1a979291 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.767467 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291526f-e8f1-4759-9e60-beaf1a979291 None admin] PATH_INFO: `/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.769393 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291526f-e8f1-4759-9e60-beaf1a979291 None admin] RBAC: Authorizing `identity:get_user(user_id=c2c0cf22337e45c78e8cb5635c37dbcb)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:06.770915 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291526f-e8f1-4759-9e60-beaf1a979291 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:06.772555 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:06 2022] GET /identity/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:06.778095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291526f-e8f1-4759-9e60-beaf1a979291 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:06.842790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f88e9-93ee-4f95-b7f9-633268b0052e None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:06.877074 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804114-a3c8-4153-823a-d92fec8ffc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:06.877894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804114-a3c8-4153-823a-d92fec8ffc16 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.878049 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291526f-e8f1-4759-9e60-beaf1a979291 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:06.878206 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804114-a3c8-4153-823a-d92fec8ffc16 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.878566 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804114-a3c8-4153-823a-d92fec8ffc16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.879748 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b804114-a3c8-4153-823a-d92fec8ffc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:06.881222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b804114-a3c8-4153-823a-d92fec8ffc16 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:06.882933 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 28/54] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:06.888412 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:06.888549 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804114-a3c8-4153-823a-d92fec8ffc16 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:06.914139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c49ca-57c0-4844-b398-1b6c30462298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:06.914972 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c49ca-57c0-4844-b398-1b6c30462298 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:06.915264 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c49ca-57c0-4844-b398-1b6c30462298 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:06.915548 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c49ca-57c0-4844-b398-1b6c30462298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:06.916845 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c49ca-57c0-4844-b398-1b6c30462298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:06.918722 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c49ca-57c0-4844-b398-1b6c30462298 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:06.919848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:06.925646 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:06.926230 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c49ca-57c0-4844-b398-1b6c30462298 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:06.990234 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804114-a3c8-4153-823a-d92fec8ffc16 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:07.025222 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c49ca-57c0-4844-b398-1b6c30462298 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:07.025372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a682a1-5bf0-449a-ad8b-ffe0780af6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:07.025980 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a682a1-5bf0-449a-ad8b-ffe0780af6cc None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:07.026275 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a682a1-5bf0-449a-ad8b-ffe0780af6cc None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:07.026596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a682a1-5bf0-449a-ad8b-ffe0780af6cc None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:07.027354 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a682a1-5bf0-449a-ad8b-ffe0780af6cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:07.028823 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a682a1-5bf0-449a-ad8b-ffe0780af6cc None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:07.058563 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e1197-080a-4c0c-85d2-c6a46e7819e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:07.060291 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e1197-080a-4c0c-85d2-c6a46e7819e2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:07.060291 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e1197-080a-4c0c-85d2-c6a46e7819e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:07.060291 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e1197-080a-4c0c-85d2-c6a46e7819e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:07.060570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e1197-080a-4c0c-85d2-c6a46e7819e2 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.domain.id=default, user.id=c2c0cf22337e45c78e8cb5635c37dbcb) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:07.060880 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e1197-080a-4c0c-85d2-c6a46e7819e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:07.062315 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e1197-080a-4c0c-85d2-c6a46e7819e2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:07.071699 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 28/56] 10.222.0.67 () {56 vars in 1322 bytes} [Mon Jul 25 09:32:06 2022] GET /identity/v3/role_assignments?user.id=c2c0cf22337e45c78e8cb5635c37dbcb&scope.domain.id=default&role.id=bd8b88fae376413398183761500b2e1d => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:07.120128 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 29/57] 10.222.0.67 () {60 vars in 1140 bytes} [Mon Jul 25 09:32:06 2022] POST /identity/v3/projects => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:32:09.353039 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100b20-efd6-43ea-886a-4683f006487e None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:09.353514 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100b20-efd6-43ea-886a-4683f006487e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:09.353598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100b20-efd6-43ea-886a-4683f006487e None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:09.355011 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 29/58] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:09.360321 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724736-2a6b-412a-83dd-03b1afdf4fa6 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:09.360743 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724736-2a6b-412a-83dd-03b1afdf4fa6 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:09.360898 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724736-2a6b-412a-83dd-03b1afdf4fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:09.379947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-45724736-2a6b-412a-83dd-03b1afdf4fa6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:09.381144 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-45724736-2a6b-412a-83dd-03b1afdf4fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:09.449700 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 30/59] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:09.476262 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf100b20-efd6-43ea-886a-4683f006487e None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:09.520278 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:09.581125 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf100b20-efd6-43ea-886a-4683f006487e None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:09.618017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284bd5a-6da0-4009-8d31-e9f8fea45a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:09.618807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284bd5a-6da0-4009-8d31-e9f8fea45a19 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:09.619135 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284bd5a-6da0-4009-8d31-e9f8fea45a19 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:09.619460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284bd5a-6da0-4009-8d31-e9f8fea45a19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:09.620734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284bd5a-6da0-4009-8d31-e9f8fea45a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:09.622198 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284bd5a-6da0-4009-8d31-e9f8fea45a19 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:09.623851 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 30/60] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:09.629465 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724736-2a6b-412a-83dd-03b1afdf4fa6 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:09.646696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:09.737334 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724736-2a6b-412a-83dd-03b1afdf4fa6 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:09.773265 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b11749-0542-48f3-8af9-88c71e40d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:09.773939 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11749-0542-48f3-8af9-88c71e40d2a1 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:09.774227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11749-0542-48f3-8af9-88c71e40d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:09.774541 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11749-0542-48f3-8af9-88c71e40d2a1 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:09.775269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b11749-0542-48f3-8af9-88c71e40d2a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:09.776777 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b11749-0542-48f3-8af9-88c71e40d2a1 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:09.930083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 31/61] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:32:09 2022] POST /identity/v3/users => generated 275 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:13.398195 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d609c-586e-429c-906b-638683095a6e None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:13.398744 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d609c-586e-429c-906b-638683095a6e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:13.398872 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d609c-586e-429c-906b-638683095a6e None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:13.400261 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 31/62] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:13.405694 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb158-c6ee-4380-98e3-b65ff1eb869e None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:13.406126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb158-c6ee-4380-98e3-b65ff1eb869e None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:13.406266 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb158-c6ee-4380-98e3-b65ff1eb869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:13.447537 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-052fb158-c6ee-4380-98e3-b65ff1eb869e None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:13.448744 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-052fb158-c6ee-4380-98e3-b65ff1eb869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:13.585692 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:13.592874 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 32/63] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:13.629593 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d609c-586e-429c-906b-638683095a6e None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:13.678115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69601123-42e5-49ac-885d-c8de95b01337 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:13.678419 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69601123-42e5-49ac-885d-c8de95b01337 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:13.678751 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69601123-42e5-49ac-885d-c8de95b01337 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:13.680280 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 33/64] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:13.695109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de26acf-5dbd-413a-a728-f632c2fb8def None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:13.695418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de26acf-5dbd-413a-a728-f632c2fb8def None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:13.695697 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de26acf-5dbd-413a-a728-f632c2fb8def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:13.728615 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-6de26acf-5dbd-413a-a728-f632c2fb8def None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:13.729827 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-6de26acf-5dbd-413a-a728-f632c2fb8def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:13.860922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 34/65] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:13.875304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d609c-586e-429c-906b-638683095a6e None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:13.887238 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:13.895589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de26acf-5dbd-413a-a728-f632c2fb8def None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:13.929487 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a21c1c-da14-4cd2-beb6-69ff6972bb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:13.930453 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a21c1c-da14-4cd2-beb6-69ff6972bb58 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:13.930772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a21c1c-da14-4cd2-beb6-69ff6972bb58 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:13.931075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a21c1c-da14-4cd2-beb6-69ff6972bb58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:13.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a21c1c-da14-4cd2-beb6-69ff6972bb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-e3a21c1c-da14-4cd2-beb6-69ff6972bb58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:13.981470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:13.982418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:13.983706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 32/66] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:13.989367 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a21c1c-da14-4cd2-beb6-69ff6972bb58 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:14.102506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de26acf-5dbd-413a-a728-f632c2fb8def None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:14.150961 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:14.160637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6760813-f292-48ae-9479-87712115dcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:14.171071 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760813-f292-48ae-9479-87712115dcef None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.171071 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760813-f292-48ae-9479-87712115dcef None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.171071 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6760813-f292-48ae-9479-87712115dcef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.175602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a21c1c-da14-4cd2-beb6-69ff6972bb58 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:14.175912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6760813-f292-48ae-9479-87712115dcef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-e6760813-f292-48ae-9479-87712115dcef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:14.184949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:14.185921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:14.186714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:14.190765 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 35/67] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:14.192460 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61a278-c8fe-41ec-8471-a0784c1d29b8 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.192975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61a278-c8fe-41ec-8471-a0784c1d29b8 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.195386 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61a278-c8fe-41ec-8471-a0784c1d29b8 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.202992 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 36/68] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:14.204140 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61a278-c8fe-41ec-8471-a0784c1d29b8 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:14.235174 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41316499-902b-4095-9671-cee5b0ecadc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:14.235863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41316499-902b-4095-9671-cee5b0ecadc5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.236156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41316499-902b-4095-9671-cee5b0ecadc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.236441 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41316499-902b-4095-9671-cee5b0ecadc5 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.238026 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41316499-902b-4095-9671-cee5b0ecadc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:14.238348 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41316499-902b-4095-9671-cee5b0ecadc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:14.242768 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41316499-902b-4095-9671-cee5b0ecadc5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:14.261510 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 33/69] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:14.262904 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5643-3a79-4b98-850d-469ac658ad48 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.263130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5643-3a79-4b98-850d-469ac658ad48 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.263379 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5643-3a79-4b98-850d-469ac658ad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.311904 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-3a8e5643-3a79-4b98-850d-469ac658ad48 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:14.313136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-3a8e5643-3a79-4b98-850d-469ac658ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:14.366399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:14.417308 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61a278-c8fe-41ec-8471-a0784c1d29b8 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:14.439042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 34/70] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:14.441945 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5643-3a79-4b98-850d-469ac658ad48 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:14.492982 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:14.493677 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.493969 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.494255 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.495047 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:14.495365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:14.496796 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:14.509261 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 37/71] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:14.510365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:14.602014 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:14.628952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5643-3a79-4b98-850d-469ac658ad48 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:14.668407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7f43d-1a56-450d-9f2e-14d307390d28 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:14.678593 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202583-dcd5-4a51-8d25-80c80ed25efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:14.679506 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202583-dcd5-4a51-8d25-80c80ed25efc None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.679798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202583-dcd5-4a51-8d25-80c80ed25efc None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.680081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9202583-dcd5-4a51-8d25-80c80ed25efc None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.698167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9202583-dcd5-4a51-8d25-80c80ed25efc None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:14.699778 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9202583-dcd5-4a51-8d25-80c80ed25efc None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:14.701601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 35/72] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:14 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:14.707604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202583-dcd5-4a51-8d25-80c80ed25efc None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:14.716859 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c672d2-a825-473b-b17e-ce90117d5a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:14.718281 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c672d2-a825-473b-b17e-ce90117d5a3f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.718609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c672d2-a825-473b-b17e-ce90117d5a3f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.718895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c672d2-a825-473b-b17e-ce90117d5a3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.729301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:14.734620 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c672d2-a825-473b-b17e-ce90117d5a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-33c672d2-a825-473b-b17e-ce90117d5a3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:14.745930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:14.746841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:14.747587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 38/73] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:14.751391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432927fc-b360-4c29-a1d5-8b4301f746e9 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.751391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432927fc-b360-4c29-a1d5-8b4301f746e9 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.757704 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432927fc-b360-4c29-a1d5-8b4301f746e9 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.757704 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 39/74] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:14.758788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432927fc-b360-4c29-a1d5-8b4301f746e9 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:14.829007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9202583-dcd5-4a51-8d25-80c80ed25efc None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:14.872196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3a48-d64e-467a-82a1-3d12c40805e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:14.873260 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3a48-d64e-467a-82a1-3d12c40805e5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.873557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3a48-d64e-467a-82a1-3d12c40805e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.873843 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3a48-d64e-467a-82a1-3d12c40805e5 None admin] PATH_INFO: `/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.875113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a3a48-d64e-467a-82a1-3d12c40805e5 None admin] RBAC: Authorizing `identity:get_user(user_id=c2c0cf22337e45c78e8cb5635c37dbcb)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:14.876679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a3a48-d64e-467a-82a1-3d12c40805e5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:14.878680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 36/75] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:14 2022] GET /identity/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:14.882878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3a48-d64e-467a-82a1-3d12c40805e5 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:14.883532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432927fc-b360-4c29-a1d5-8b4301f746e9 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:14.900583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:14.925532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c6058-a669-492e-add2-0a305aff0a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:14.926141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6058-a669-492e-add2-0a305aff0a8c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:14.926438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6058-a669-492e-add2-0a305aff0a8c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:14.926777 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6058-a669-492e-add2-0a305aff0a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:14.983745 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:14.997338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3a48-d64e-467a-82a1-3d12c40805e5 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:15.011166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c6058-a669-492e-add2-0a305aff0a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:15.012785 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c6058-a669-492e-add2-0a305aff0a8c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:15.036056 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bba9c-d5f5-4c39-bec6-6d142327a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:15.037223 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bba9c-d5f5-4c39-bec6-6d142327a256 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.037522 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bba9c-d5f5-4c39-bec6-6d142327a256 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.037931 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bba9c-d5f5-4c39-bec6-6d142327a256 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.038681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bba9c-d5f5-4c39-bec6-6d142327a256 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:15.039003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bba9c-d5f5-4c39-bec6-6d142327a256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:15.040409 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bba9c-d5f5-4c39-bec6-6d142327a256 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:15.049385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 37/76] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:15.050736 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb886ec8-7d5d-4bac-a40d-3d213608cebe None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.051033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb886ec8-7d5d-4bac-a40d-3d213608cebe None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.051318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb886ec8-7d5d-4bac-a40d-3d213608cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.070065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-fb886ec8-7d5d-4bac-a40d-3d213608cebe None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:15.071276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-fb886ec8-7d5d-4bac-a40d-3d213608cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:15.125688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 40/77] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:15.128573 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f617ae6-c6cd-4d58-b95d-e871678c8106 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.128997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f617ae6-c6cd-4d58-b95d-e871678c8106 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.129526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f617ae6-c6cd-4d58-b95d-e871678c8106 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.131649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 41/78] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:15.132736 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f617ae6-c6cd-4d58-b95d-e871678c8106 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:15.149448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:15.151297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 38/79] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:15.152168 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb886ec8-7d5d-4bac-a40d-3d213608cebe None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:15.247815 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f617ae6-c6cd-4d58-b95d-e871678c8106 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:15.248592 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:15.272692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb886ec8-7d5d-4bac-a40d-3d213608cebe None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:15.289813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892ebb-443a-477f-9bd0-8292bf02f5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:15.290679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892ebb-443a-477f-9bd0-8292bf02f5a3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.290979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892ebb-443a-477f-9bd0-8292bf02f5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.291270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892ebb-443a-477f-9bd0-8292bf02f5a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.312578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2690d-b9ba-4f2b-a433-69e10e0be572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:15.313472 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2690d-b9ba-4f2b-a433-69e10e0be572 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.313760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2690d-b9ba-4f2b-a433-69e10e0be572 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.314148 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2690d-b9ba-4f2b-a433-69e10e0be572 None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.316040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2690d-b9ba-4f2b-a433-69e10e0be572 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:15.317677 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2690d-b9ba-4f2b-a433-69e10e0be572 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:15.319404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 39/80] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:15 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:15.320184 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2690d-b9ba-4f2b-a433-69e10e0be572 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:15.374443 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f892ebb-443a-477f-9bd0-8292bf02f5a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:15.375969 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f892ebb-443a-477f-9bd0-8292bf02f5a3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:15.390802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:15.434724 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2690d-b9ba-4f2b-a433-69e10e0be572 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:15.474191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40775d09-e641-431a-81b2-a413bc550ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:15.475105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775d09-e641-431a-81b2-a413bc550ee1 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.475403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775d09-e641-431a-81b2-a413bc550ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.475686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40775d09-e641-431a-81b2-a413bc550ee1 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.477038 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40775d09-e641-431a-81b2-a413bc550ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:15.478570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40775d09-e641-431a-81b2-a413bc550ee1 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:15.480372 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 40/81] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:15 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:15.481454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5256c-c3e4-45c7-8ddc-895e458d9ad6 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.481745 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5256c-c3e4-45c7-8ddc-895e458d9ad6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.482035 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5256c-c3e4-45c7-8ddc-895e458d9ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.489090 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 42/82] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:15.489954 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892ebb-443a-477f-9bd0-8292bf02f5a3 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:15.507755 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-b4e5256c-c3e4-45c7-8ddc-895e458d9ad6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:15.508902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-b4e5256c-c3e4-45c7-8ddc-895e458d9ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:15.520052 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:15.584698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 41/83] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:15.586449 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5256c-c3e4-45c7-8ddc-895e458d9ad6 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:15.605328 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892ebb-443a-477f-9bd0-8292bf02f5a3 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:15.626081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:15.646497 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad05341-507e-4a62-a759-9239b02050df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:15.647558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad05341-507e-4a62-a759-9239b02050df None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.647979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad05341-507e-4a62-a759-9239b02050df None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.648457 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad05341-507e-4a62-a759-9239b02050df None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.660879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad05341-507e-4a62-a759-9239b02050df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-8ad05341-507e-4a62-a759-9239b02050df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:15.669679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:15.670616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:15.671387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 43/84] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:15.672002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad05341-507e-4a62-a759-9239b02050df None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:15.698771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5256c-c3e4-45c7-8ddc-895e458d9ad6 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:15.740605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7509-9d81-4af9-8846-7be275701a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:15.741272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7509-9d81-4af9-8846-7be275701a2e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.741568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7509-9d81-4af9-8846-7be275701a2e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.741944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7509-9d81-4af9-8846-7be275701a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.758984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:15.785612 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad05341-507e-4a62-a759-9239b02050df None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:15.820567 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c7509-9d81-4af9-8846-7be275701a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:15.822151 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c7509-9d81-4af9-8846-7be275701a2e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:15.827645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:15.828407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:15.828773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:15.829134 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:15.829984 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] RBAC: Adding query filter params (role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=d5c2839cdfc7453089ac16e62f08a110, user.id=d7bdcb82cda748ea91e11af6871a68bf) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:15.830307 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:15.833811 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:15.840581 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 44/85] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:15 2022] GET /identity/v3/role_assignments?user.id=d7bdcb82cda748ea91e11af6871a68bf&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:15.841195 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:15.887379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:15.960522 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 42/86] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:15.961715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7509-9d81-4af9-8846-7be275701a2e None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:15.978407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c58bf-a12e-4d14-9682-4586c90393d9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.030549 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:16.037778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62319a-9ef4-4e8a-bcc1-7f7702131adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:16.043341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62319a-9ef4-4e8a-bcc1-7f7702131adf None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:16.043341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62319a-9ef4-4e8a-bcc1-7f7702131adf None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:16.043341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62319a-9ef4-4e8a-bcc1-7f7702131adf None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:16.043341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62319a-9ef4-4e8a-bcc1-7f7702131adf None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:16.043341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62319a-9ef4-4e8a-bcc1-7f7702131adf None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:16.043825 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 45/87] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:15 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:16.044717 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62319a-9ef4-4e8a-bcc1-7f7702131adf None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:16.109928 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7509-9d81-4af9-8846-7be275701a2e None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.154400 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67494135-31bf-4a4d-b208-53f8e5e1520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:16.155258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67494135-31bf-4a4d-b208-53f8e5e1520b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:16.155552 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67494135-31bf-4a4d-b208-53f8e5e1520b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:16.155836 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67494135-31bf-4a4d-b208-53f8e5e1520b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:16.157531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67494135-31bf-4a4d-b208-53f8e5e1520b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:16.159705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67494135-31bf-4a4d-b208-53f8e5e1520b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:16.162095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 43/88] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:16.163062 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67494135-31bf-4a4d-b208-53f8e5e1520b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:16.176406 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62319a-9ef4-4e8a-bcc1-7f7702131adf None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.180540 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:16.219173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:16.220088 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:16.220385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:16.220671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:16.221696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:16.222241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:16.223863 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:16.237683 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 46/89] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:16.237683 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:16.312276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67494135-31bf-4a4d-b208-53f8e5e1520b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.331674 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:16.364311 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f727ec9-99ea-4122-9f30-0ad49d4d95e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:16.365410 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f727ec9-99ea-4122-9f30-0ad49d4d95e9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:16.365705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f727ec9-99ea-4122-9f30-0ad49d4d95e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:16.365995 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f727ec9-99ea-4122-9f30-0ad49d4d95e9 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:16.367258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f727ec9-99ea-4122-9f30-0ad49d4d95e9 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:16.369030 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f727ec9-99ea-4122-9f30-0ad49d4d95e9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:16.369519 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2b13a-de8b-476b-a431-012f008c4d1c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.375570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 44/90] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:16 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:16.375570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f727ec9-99ea-4122-9f30-0ad49d4d95e9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:16.425257 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:16.425936 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:16.426564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:16.426862 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:16.427725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=d5c2839cdfc7453089ac16e62f08a110, user.id=c2c0cf22337e45c78e8cb5635c37dbcb) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:16.428053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:16.429561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:16.435994 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 47/91] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:16 2022] GET /identity/v3/role_assignments?user.id=c2c0cf22337e45c78e8cb5635c37dbcb&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=bd8b88fae376413398183761500b2e1d => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:16.436811 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:16.474302 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:16.528281 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f727ec9-99ea-4122-9f30-0ad49d4d95e9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.590269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1adb5-e08e-4014-8873-06f7df6b9b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:16.591891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1adb5-e08e-4014-8873-06f7df6b9b4b None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:16.593147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1adb5-e08e-4014-8873-06f7df6b9b4b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:16.597194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1adb5-e08e-4014-8873-06f7df6b9b4b None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:16.600187 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1adb5-e08e-4014-8873-06f7df6b9b4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:16.601722 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1adb5-e08e-4014-8873-06f7df6b9b4b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:16.603618 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b160900-81f7-4a4e-928b-25340b4ff4e6 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.653351 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0289d9-170a-4138-9870-6a585d5c4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:16.654242 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0289d9-170a-4138-9870-6a585d5c4a9e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:16.655307 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0289d9-170a-4138-9870-6a585d5c4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:16.655307 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0289d9-170a-4138-9870-6a585d5c4a9e None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:16.656298 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0289d9-170a-4138-9870-6a585d5c4a9e None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:16.657781 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0289d9-170a-4138-9870-6a585d5c4a9e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:16.660343 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 48/92] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:16 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:16.660578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0289d9-170a-4138-9870-6a585d5c4a9e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:16.729268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 45/93] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:32:16 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:16.730186 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1adb5-e08e-4014-8873-06f7df6b9b4b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:16.783288 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:16.873964 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1adb5-e08e-4014-8873-06f7df6b9b4b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.878250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:16.894215 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0289d9-170a-4138-9870-6a585d5c4a9e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:16.926347 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d02020-5f72-40c3-b97e-0e14f27e5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:16.927811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d02020-5f72-40c3-b97e-0e14f27e5772 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:16.928284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d02020-5f72-40c3-b97e-0e14f27e5772 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:16.928741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d02020-5f72-40c3-b97e-0e14f27e5772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:17.005463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:17.006260 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:17.006578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:17.006865 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:17.007732 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] RBAC: Adding query filter params (role.id=fdcb4b876026440b87d75e4de6fdedcd, scope.project.id=d5c2839cdfc7453089ac16e62f08a110, user.id=d7bdcb82cda748ea91e11af6871a68bf) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:17.008038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:17.009636 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:17.018374 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d02020-5f72-40c3-b97e-0e14f27e5772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:17.020240 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d02020-5f72-40c3-b97e-0e14f27e5772 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:17.028255 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 49/94] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:16 2022] GET /identity/v3/role_assignments?user.id=d7bdcb82cda748ea91e11af6871a68bf&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=fdcb4b876026440b87d75e4de6fdedcd => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:17.075232 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:17.168214 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 46/95] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:17.168413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:17.336462 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57fc0c-cf0e-4f82-ac5b-4aba6f48e61d None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:17.378539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60033f6f-1165-4609-bda5-4d6d701ecc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:17.378539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60033f6f-1165-4609-bda5-4d6d701ecc9d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:17.378539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60033f6f-1165-4609-bda5-4d6d701ecc9d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:17.378539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60033f6f-1165-4609-bda5-4d6d701ecc9d None admin] PATH_INFO: `/v3/projects/70f7a0a476d546298c8d76ee28980c42` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:17.379115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60033f6f-1165-4609-bda5-4d6d701ecc9d None admin] RBAC: Authorizing `identity:get_project(project_id=70f7a0a476d546298c8d76ee28980c42)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:17.382491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60033f6f-1165-4609-bda5-4d6d701ecc9d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:17.382491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 50/96] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:17 2022] GET /identity/v3/projects/70f7a0a476d546298c8d76ee28980c42 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:17.393975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d02020-5f72-40c3-b97e-0e14f27e5772 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:17.551059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d02020-5f72-40c3-b97e-0e14f27e5772 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:17.590071 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01340e38-b567-4811-8c39-5cbb9a2138d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:17.590844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01340e38-b567-4811-8c39-5cbb9a2138d9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:17.591140 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01340e38-b567-4811-8c39-5cbb9a2138d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:17.591428 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01340e38-b567-4811-8c39-5cbb9a2138d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:17.592280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01340e38-b567-4811-8c39-5cbb9a2138d9 None admin] RBAC: Adding query filter params (role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=70f7a0a476d546298c8d76ee28980c42, user.id=d7bdcb82cda748ea91e11af6871a68bf) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:17.592603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01340e38-b567-4811-8c39-5cbb9a2138d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:17.594089 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01340e38-b567-4811-8c39-5cbb9a2138d9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:17.597959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:17.601673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 47/97] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:17 2022] GET /identity/v3/role_assignments?user.id=d7bdcb82cda748ea91e11af6871a68bf&scope.project.id=70f7a0a476d546298c8d76ee28980c42&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:18.492583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11e07f-5124-4833-bb59-98e6399cc85d None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:18.493101 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11e07f-5124-4833-bb59-98e6399cc85d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:18.493175 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11e07f-5124-4833-bb59-98e6399cc85d None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:18.495001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 51/98] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:18.500911 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5236339-832c-43f9-a2c2-97dad1c226b7 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:18.501214 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5236339-832c-43f9-a2c2-97dad1c226b7 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:18.501507 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5236339-832c-43f9-a2c2-97dad1c226b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:18.529460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-a5236339-832c-43f9-a2c2-97dad1c226b7 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:18.530703 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-a5236339-832c-43f9-a2c2-97dad1c226b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:18.660910 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 48/99] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:18.700141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11e07f-5124-4833-bb59-98e6399cc85d None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:18.743828 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:18.829102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11e07f-5124-4833-bb59-98e6399cc85d None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:18.869067 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791332b-c145-42f0-b6ba-2608f2b3928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:18.869284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791332b-c145-42f0-b6ba-2608f2b3928f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:18.869527 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791332b-c145-42f0-b6ba-2608f2b3928f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:18.869764 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791332b-c145-42f0-b6ba-2608f2b3928f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:18.881958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791332b-c145-42f0-b6ba-2608f2b3928f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-c791332b-c145-42f0-b6ba-2608f2b3928f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:18.889989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:18.891080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:18.891830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 52/100] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:18.898658 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5236339-832c-43f9-a2c2-97dad1c226b7 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:19.112694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5236339-832c-43f9-a2c2-97dad1c226b7 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:19.176207 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:19.188076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:19.188769 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:19.189061 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:19.189346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:19.190140 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] RBAC: Adding query filter params (name=member) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:19.190476 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:19.191895 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:19.210043 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 49/101] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:19.219752 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791332b-c145-42f0-b6ba-2608f2b3928f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:19.386838 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:19.404200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791332b-c145-42f0-b6ba-2608f2b3928f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:19.453038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208ceb7-6213-4874-bb93-c6585f713ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:19.453959 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208ceb7-6213-4874-bb93-c6585f713ef6 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:19.454281 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208ceb7-6213-4874-bb93-c6585f713ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:19.454611 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208ceb7-6213-4874-bb93-c6585f713ef6 None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:19.458490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208ceb7-6213-4874-bb93-c6585f713ef6 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:19.458490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208ceb7-6213-4874-bb93-c6585f713ef6 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:19.464375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 53/102] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:19 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:19.472258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:19.727082 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9e58c-f707-49fc-9cec-8595f71afb3c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:19.824672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc2132-2f01-43f7-8d6e-b0a4ec5be4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:19.825849 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc2132-2f01-43f7-8d6e-b0a4ec5be4a5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:19.826313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc2132-2f01-43f7-8d6e-b0a4ec5be4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:19.826812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc2132-2f01-43f7-8d6e-b0a4ec5be4a5 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:19.829255 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc2132-2f01-43f7-8d6e-b0a4ec5be4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:19.831539 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc2132-2f01-43f7-8d6e-b0a4ec5be4a5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:19.836938 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 50/103] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:19 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:19.842447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208ceb7-6213-4874-bb93-c6585f713ef6 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:19.921856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76b300-9aa1-4ac6-b421-276c5c5f0ecf None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:19.922530 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76b300-9aa1-4ac6-b421-276c5c5f0ecf None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:19.923105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76b300-9aa1-4ac6-b421-276c5c5f0ecf None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:19.924735 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 51/104] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:19.930304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c65d7-91e5-4641-8a5c-58a5843ff236 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:19.930910 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c65d7-91e5-4641-8a5c-58a5843ff236 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:19.931397 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c65d7-91e5-4641-8a5c-58a5843ff236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:19.983980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-512c65d7-91e5-4641-8a5c-58a5843ff236 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:19.985569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-512c65d7-91e5-4641-8a5c-58a5843ff236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:20.039233 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208ceb7-6213-4874-bb93-c6585f713ef6 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:20.101849 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:20.106104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0cec1-38ff-4e75-babf-7e7c09ed8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:20.107113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0cec1-38ff-4e75-babf-7e7c09ed8669 None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:20.107408 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0cec1-38ff-4e75-babf-7e7c09ed8669 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:20.107691 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0cec1-38ff-4e75-babf-7e7c09ed8669 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110/users/d7bdcb82cda748ea91e11af6871a68bf/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:20.116002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0cec1-38ff-4e75-babf-7e7c09ed8669 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5c2839cdfc7453089ac16e62f08a110, user_id=d7bdcb82cda748ea91e11af6871a68bf, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:20.117773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0cec1-38ff-4e75-babf-7e7c09ed8669 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:20.131994 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 52/105] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:20.169125 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c65d7-91e5-4641-8a5c-58a5843ff236 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:20.231328 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 54/106] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:19 2022] PUT /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110/users/d7bdcb82cda748ea91e11af6871a68bf/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:20.351666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c65d7-91e5-4641-8a5c-58a5843ff236 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:20.419242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f5594-d703-4836-ab7e-c9f238cef2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:20.420541 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f5594-d703-4836-ab7e-c9f238cef2d7 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:20.421013 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f5594-d703-4836-ab7e-c9f238cef2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:20.421490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f5594-d703-4836-ab7e-c9f238cef2d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:20.455635 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f5594-d703-4836-ab7e-c9f238cef2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-180f5594-d703-4836-ab7e-c9f238cef2d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:20.464166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:20.465107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:20.466310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 53/107] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:32:20.473163 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0cec1-38ff-4e75-babf-7e7c09ed8669 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:20.496798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6332-65cd-4d4f-91ce-2d63212c828a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:20.497101 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6332-65cd-4d4f-91ce-2d63212c828a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:20.497375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6332-65cd-4d4f-91ce-2d63212c828a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:20.498833 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 54/108] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:32:20.512296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:20.516239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d784a-5846-4452-bab7-b5e42246b775 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:20.516567 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d784a-5846-4452-bab7-b5e42246b775 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:20.518646 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d784a-5846-4452-bab7-b5e42246b775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:20.558496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-b40d784a-5846-4452-bab7-b5e42246b775 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:20.561468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-b40d784a-5846-4452-bab7-b5e42246b775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:20.670574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:20.670737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0cec1-38ff-4e75-babf-7e7c09ed8669 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:20.705290 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 55/109] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:20.737442 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:20.738180 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:20.738493 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:20.738793 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:20.739580 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:20.739901 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:20.741339 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:20.743829 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d784a-5846-4452-bab7-b5e42246b775 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:20.756483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 55/110] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:20.764379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:20.935291 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:20.961982 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7d001-89b5-485f-b3ea-52ee392c9bcf None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:20.964752 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d784a-5846-4452-bab7-b5e42246b775 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:21.012174 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d641585-bdd3-4b56-8f3a-2068a3cb8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:21.013575 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d641585-bdd3-4b56-8f3a-2068a3cb8f35 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.014071 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d641585-bdd3-4b56-8f3a-2068a3cb8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.014632 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d641585-bdd3-4b56-8f3a-2068a3cb8f35 None admin] PATH_INFO: `/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.020151 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d641585-bdd3-4b56-8f3a-2068a3cb8f35 None admin] RBAC: Authorizing `identity:get_user(user_id=c2c0cf22337e45c78e8cb5635c37dbcb)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:21.022078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d641585-bdd3-4b56-8f3a-2068a3cb8f35 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:21.024123 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 56/111] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:20 2022] GET /identity/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:21.035854 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d641585-bdd3-4b56-8f3a-2068a3cb8f35 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:21.039473 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b00802-08f5-4cc1-bc00-3e3492f333a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:21.040310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b00802-08f5-4cc1-bc00-3e3492f333a3 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.040599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b00802-08f5-4cc1-bc00-3e3492f333a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.040882 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b00802-08f5-4cc1-bc00-3e3492f333a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.082521 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b00802-08f5-4cc1-bc00-3e3492f333a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-d2b00802-08f5-4cc1-bc00-3e3492f333a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:21.104486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:21.105482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:21.106258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 56/112] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:21.114500 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b00802-08f5-4cc1-bc00-3e3492f333a3 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:21.228463 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:21.254906 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d641585-bdd3-4b56-8f3a-2068a3cb8f35 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:21.357512 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b00802-08f5-4cc1-bc00-3e3492f333a3 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:21.385341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f72c4-e4c6-49b2-ba8f-070ea02f8467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:21.387388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f72c4-e4c6-49b2-ba8f-070ea02f8467 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.387388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f72c4-e4c6-49b2-ba8f-070ea02f8467 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.387388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f72c4-e4c6-49b2-ba8f-070ea02f8467 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.388061 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f72c4-e4c6-49b2-ba8f-070ea02f8467 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:21.389526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f72c4-e4c6-49b2-ba8f-070ea02f8467 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:21.391506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 57/113] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:21 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:21.403862 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f72c4-e4c6-49b2-ba8f-070ea02f8467 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:21.442776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:21.447861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ac0e7-e12d-4b78-b50d-fb1f3a96d38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:21.448016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac0e7-e12d-4b78-b50d-fb1f3a96d38a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.448218 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac0e7-e12d-4b78-b50d-fb1f3a96d38a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.448459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ac0e7-e12d-4b78-b50d-fb1f3a96d38a None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.452256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ac0e7-e12d-4b78-b50d-fb1f3a96d38a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:21.452256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ac0e7-e12d-4b78-b50d-fb1f3a96d38a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:21.452256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ac0e7-e12d-4b78-b50d-fb1f3a96d38a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:21.469488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 57/114] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:21.474490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66164805-a26e-4e7e-b38b-a22d01d5c63f None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.475576 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66164805-a26e-4e7e-b38b-a22d01d5c63f None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.475576 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66164805-a26e-4e7e-b38b-a22d01d5c63f None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.476499 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 58/115] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:21.484083 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66164805-a26e-4e7e-b38b-a22d01d5c63f None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:21.633687 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f72c4-e4c6-49b2-ba8f-070ea02f8467 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:21.670104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491766fb-22dd-4315-b099-cf59681b2a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:21.671405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491766fb-22dd-4315-b099-cf59681b2a1a None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.671950 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491766fb-22dd-4315-b099-cf59681b2a1a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.672435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491766fb-22dd-4315-b099-cf59681b2a1a None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110/users/c2c0cf22337e45c78e8cb5635c37dbcb/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.675428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491766fb-22dd-4315-b099-cf59681b2a1a None admin] RBAC: Authorizing `identity:create_grant(project_id=d5c2839cdfc7453089ac16e62f08a110, user_id=c2c0cf22337e45c78e8cb5635c37dbcb, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:21.675539 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66164805-a26e-4e7e-b38b-a22d01d5c63f None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:21.677311 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491766fb-22dd-4315-b099-cf59681b2a1a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:21.677972 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:21.713298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dcda7-5b27-449e-8dee-c6adb830e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:21.714179 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dcda7-5b27-449e-8dee-c6adb830e936 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.714483 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dcda7-5b27-449e-8dee-c6adb830e936 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.714772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dcda7-5b27-449e-8dee-c6adb830e936 None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.715979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dcda7-5b27-449e-8dee-c6adb830e936 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:21.718623 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dcda7-5b27-449e-8dee-c6adb830e936 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:21.725649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 59/116] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:21 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:21.727113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8335c-3f37-45bd-bf1d-32734dd7d841 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.728830 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8335c-3f37-45bd-bf1d-32734dd7d841 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.728830 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8335c-3f37-45bd-bf1d-32734dd7d841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.747977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-91d8335c-3f37-45bd-bf1d-32734dd7d841 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:21.749101 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-91d8335c-3f37-45bd-bf1d-32734dd7d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:21.817968 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 60/117] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:21.819527 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4471-3a6c-4778-99bc-def2ab13bd76 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.819828 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4471-3a6c-4778-99bc-def2ab13bd76 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.820114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f4471-3a6c-4778-99bc-def2ab13bd76 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.821386 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 61/118] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:21.822500 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149accaa-ef35-4df8-8795-451131884d6a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.822772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149accaa-ef35-4df8-8795-451131884d6a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.823056 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149accaa-ef35-4df8-8795-451131884d6a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.824270 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 62/119] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:21.824991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149accaa-ef35-4df8-8795-451131884d6a None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:21.838399 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 58/120] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:21 2022] PUT /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110/users/c2c0cf22337e45c78e8cb5635c37dbcb/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:21.842589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836331fd-b7a8-459c-84da-066cb8a4b6ff None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:21.842589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836331fd-b7a8-459c-84da-066cb8a4b6ff None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:21.842589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836331fd-b7a8-459c-84da-066cb8a4b6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:21.881178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-836331fd-b7a8-459c-84da-066cb8a4b6ff None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:21.883441 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-836331fd-b7a8-459c-84da-066cb8a4b6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:22.044950 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 59/121] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:22.046386 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a29fc-03d5-4029-bfb2-4ab3f8f5a5c4 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:22.046711 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a29fc-03d5-4029-bfb2-4ab3f8f5a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:22.046999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a29fc-03d5-4029-bfb2-4ab3f8f5a5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:22.073607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:22.087999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:22.088570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149accaa-ef35-4df8-8795-451131884d6a None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:22.098544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-654a29fc-03d5-4029-bfb2-4ab3f8f5a5c4 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:22.099882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-654a29fc-03d5-4029-bfb2-4ab3f8f5a5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:22.168203 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20044-3412-41c3-8bad-cfdaba3f1291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:22.169100 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20044-3412-41c3-8bad-cfdaba3f1291 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:22.169393 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20044-3412-41c3-8bad-cfdaba3f1291 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:22.169677 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a20044-3412-41c3-8bad-cfdaba3f1291 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:22.174952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a20044-3412-41c3-8bad-cfdaba3f1291 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:22.176440 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a20044-3412-41c3-8bad-cfdaba3f1291 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:22.178364 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 63/122] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:21 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:22.178996 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20044-3412-41c3-8bad-cfdaba3f1291 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:22.235985 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 60/123] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:22.237716 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a29fc-03d5-4029-bfb2-4ab3f8f5a5c4 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:22.398496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a20044-3412-41c3-8bad-cfdaba3f1291 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:22.436927 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a29fc-03d5-4029-bfb2-4ab3f8f5a5c4 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:22.467817 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36510-7ae9-4f70-8756-49439647bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:22.472091 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36510-7ae9-4f70-8756-49439647bb3f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:22.472091 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36510-7ae9-4f70-8756-49439647bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:22.472091 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36510-7ae9-4f70-8756-49439647bb3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:22.504244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7835-2eda-4437-8f68-7a0fa5eecc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:22.505674 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7835-2eda-4437-8f68-7a0fa5eecc51 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:22.506171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7835-2eda-4437-8f68-7a0fa5eecc51 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:22.506696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7835-2eda-4437-8f68-7a0fa5eecc51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:22.511463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:22.523724 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa36510-7ae9-4f70-8756-49439647bb3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:22.529651 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb7835-2eda-4437-8f68-7a0fa5eecc51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-6fa36510-7ae9-4f70-8756-49439647bb3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:22.546741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:22.547609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:22.548357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 64/124] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:22.549507 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36510-7ae9-4f70-8756-49439647bb3f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-69bb7835-2eda-4437-8f68-7a0fa5eecc51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:22.554922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:22.562831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 61/125] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:22.563592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7835-2eda-4437-8f68-7a0fa5eecc51 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:22.673145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:22.955146 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7835-2eda-4437-8f68-7a0fa5eecc51 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:22.956433 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36510-7ae9-4f70-8756-49439647bb3f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:23.101322 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15727336-bdef-4ce8-8ac8-b47108d35e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:23.102859 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15727336-bdef-4ce8-8ac8-b47108d35e60 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.103348 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15727336-bdef-4ce8-8ac8-b47108d35e60 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.103824 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15727336-bdef-4ce8-8ac8-b47108d35e60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.111985 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15727336-bdef-4ce8-8ac8-b47108d35e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:23.113869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1998b-2ac1-44e0-99f8-8a538f6468d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:23.114820 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1998b-2ac1-44e0-99f8-8a538f6468d5 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.115113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1998b-2ac1-44e0-99f8-8a538f6468d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.115396 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1998b-2ac1-44e0-99f8-8a538f6468d5 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110/users/d7bdcb82cda748ea91e11af6871a68bf/roles/fdcb4b876026440b87d75e4de6fdedcd` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.116970 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15727336-bdef-4ce8-8ac8-b47108d35e60 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:23.123231 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 62/126] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:23.128601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15727336-bdef-4ce8-8ac8-b47108d35e60 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:23.128706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1998b-2ac1-44e0-99f8-8a538f6468d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5c2839cdfc7453089ac16e62f08a110, user_id=d7bdcb82cda748ea91e11af6871a68bf, role_id=fdcb4b876026440b87d75e4de6fdedcd)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:23.128706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1998b-2ac1-44e0-99f8-8a538f6468d5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:23.196127 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 65/127] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:22 2022] PUT /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110/users/d7bdcb82cda748ea91e11af6871a68bf/roles/fdcb4b876026440b87d75e4de6fdedcd => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:23.197397 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1998b-2ac1-44e0-99f8-8a538f6468d5 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:23.237405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:23.291054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15727336-bdef-4ce8-8ac8-b47108d35e60 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:23.328610 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:23.342991 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:23.348141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.348141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.348141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.348141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:23.348141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:23.348141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:23.354218 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1998b-2ac1-44e0-99f8-8a538f6468d5 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:23.360263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 63/128] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:23.362000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:23.402659 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7aba6-2ba9-4e10-8223-b69a5eac40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:23.403925 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7aba6-2ba9-4e10-8223-b69a5eac40c4 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.403925 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7aba6-2ba9-4e10-8223-b69a5eac40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.403925 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7aba6-2ba9-4e10-8223-b69a5eac40c4 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.404626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7aba6-2ba9-4e10-8223-b69a5eac40c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:23.404936 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7aba6-2ba9-4e10-8223-b69a5eac40c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:23.406321 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7aba6-2ba9-4e10-8223-b69a5eac40c4 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:23.420664 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 66/129] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:23.420664 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121413-6073-4bdf-9737-602375a2bd09 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.420664 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121413-6073-4bdf-9737-602375a2bd09 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.420664 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121413-6073-4bdf-9737-602375a2bd09 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.420987 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 67/130] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:23.421547 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121413-6073-4bdf-9737-602375a2bd09 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:23.492772 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89154803-b62d-4335-94c7-474f5d7eebb6 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:23.520612 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:23.530696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98d083-c6fe-4a5e-a823-2a70f0bb47a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:23.531653 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d083-c6fe-4a5e-a823-2a70f0bb47a7 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.532703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d083-c6fe-4a5e-a823-2a70f0bb47a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.533007 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d083-c6fe-4a5e-a823-2a70f0bb47a7 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.534552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98d083-c6fe-4a5e-a823-2a70f0bb47a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:23.536301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98d083-c6fe-4a5e-a823-2a70f0bb47a7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:23.556540 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121413-6073-4bdf-9737-602375a2bd09 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:23.593254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f801db5-bfaf-4480-a83b-188dfdaebd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:23.594135 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f801db5-bfaf-4480-a83b-188dfdaebd7e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.594418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f801db5-bfaf-4480-a83b-188dfdaebd7e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.594723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f801db5-bfaf-4480-a83b-188dfdaebd7e None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.596042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f801db5-bfaf-4480-a83b-188dfdaebd7e None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:23.597485 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f801db5-bfaf-4480-a83b-188dfdaebd7e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:23.599303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 68/131] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:23 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:23.603047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f801db5-bfaf-4480-a83b-188dfdaebd7e None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:23.622853 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:23.650956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 64/132] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:32:23 2022] POST /identity/v3/projects => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:23.659725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412767c-350d-46a2-bd76-7dc4d0633576 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.660403 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412767c-350d-46a2-bd76-7dc4d0633576 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.660887 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412767c-350d-46a2-bd76-7dc4d0633576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.697084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-8412767c-350d-46a2-bd76-7dc4d0633576 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:23.703013 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-8412767c-350d-46a2-bd76-7dc4d0633576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:23.709897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f801db5-bfaf-4480-a83b-188dfdaebd7e None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:23.753668 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4b3cf-a47b-472f-b326-347019a316ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:23.754515 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4b3cf-a47b-472f-b326-347019a316ed None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:23.754811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4b3cf-a47b-472f-b326-347019a316ed None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:23.755093 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4b3cf-a47b-472f-b326-347019a316ed None admin] PATH_INFO: `/v3/users/1097abebec5343b0b8adcc546fd59cfa` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:23.790709 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4b3cf-a47b-472f-b326-347019a316ed None admin] RBAC: Authorizing `identity:get_user(user_id=1097abebec5343b0b8adcc546fd59cfa)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:23.792207 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4b3cf-a47b-472f-b326-347019a316ed None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:23.794142 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 69/133] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:23 2022] GET /identity/v3/users/1097abebec5343b0b8adcc546fd59cfa => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:23.794791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4b3cf-a47b-472f-b326-347019a316ed None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:23.851837 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 65/134] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:23.852719 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412767c-350d-46a2-bd76-7dc4d0633576 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:23.946232 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:23.965403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4b3cf-a47b-472f-b326-347019a316ed None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:24.001461 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ca0e-a426-4515-91d5-707ebc93123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:24.003179 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ca0e-a426-4515-91d5-707ebc93123b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.003643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ca0e-a426-4515-91d5-707ebc93123b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.003977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ca0e-a426-4515-91d5-707ebc93123b None admin] PATH_INFO: `/v3/projects/70f7a0a476d546298c8d76ee28980c42` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.005263 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707ca0e-a426-4515-91d5-707ebc93123b None admin] RBAC: Authorizing `identity:get_project(project_id=70f7a0a476d546298c8d76ee28980c42)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:24.008782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707ca0e-a426-4515-91d5-707ebc93123b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:24.008782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 70/135] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:23 2022] GET /identity/v3/projects/70f7a0a476d546298c8d76ee28980c42 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:24.009154 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ca0e-a426-4515-91d5-707ebc93123b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:24.053974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412767c-350d-46a2-bd76-7dc4d0633576 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:24.066953 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:24.106077 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a96822-b686-4666-9ca2-b1bd595d1344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:24.106856 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a96822-b686-4666-9ca2-b1bd595d1344 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.107112 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a96822-b686-4666-9ca2-b1bd595d1344 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.107391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a96822-b686-4666-9ca2-b1bd595d1344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.156194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ca0e-a426-4515-91d5-707ebc93123b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:24.203003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503c758-9b0b-422a-a392-bf46bfe1da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:24.203870 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c758-9b0b-422a-a392-bf46bfe1da3a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.204186 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c758-9b0b-422a-a392-bf46bfe1da3a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.204679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c758-9b0b-422a-a392-bf46bfe1da3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.220138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503c758-9b0b-422a-a392-bf46bfe1da3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-3503c758-9b0b-422a-a392-bf46bfe1da3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:24.231006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:24.231891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:24.232643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 71/136] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:24.233262 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503c758-9b0b-422a-a392-bf46bfe1da3a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:24.235267 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a96822-b686-4666-9ca2-b1bd595d1344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:24.237469 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a96822-b686-4666-9ca2-b1bd595d1344 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:24.243164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:24.373166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503c758-9b0b-422a-a392-bf46bfe1da3a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:24.411637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 66/137] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:24.416346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc36d8e-622c-4fa4-9bd3-21d54ed85687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:24.416346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc36d8e-622c-4fa4-9bd3-21d54ed85687 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.416346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc36d8e-622c-4fa4-9bd3-21d54ed85687 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.416346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc36d8e-622c-4fa4-9bd3-21d54ed85687 None admin] PATH_INFO: `/v3/projects/70f7a0a476d546298c8d76ee28980c42/users/d7bdcb82cda748ea91e11af6871a68bf/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.416667 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc36d8e-622c-4fa4-9bd3-21d54ed85687 None admin] RBAC: Authorizing `identity:create_grant(project_id=70f7a0a476d546298c8d76ee28980c42, user_id=d7bdcb82cda748ea91e11af6871a68bf, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:24.417503 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc36d8e-622c-4fa4-9bd3-21d54ed85687 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:24.418022 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a96822-b686-4666-9ca2-b1bd595d1344 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:24.430850 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:24.495004 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 72/138] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:24 2022] PUT /identity/v3/projects/70f7a0a476d546298c8d76ee28980c42/users/d7bdcb82cda748ea91e11af6871a68bf/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:24.496360 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d78ffb-f1e8-466e-ac76-4c06c930d937 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.496652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d78ffb-f1e8-466e-ac76-4c06c930d937 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.497035 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d78ffb-f1e8-466e-ac76-4c06c930d937 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.502720 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 73/139] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:24.502720 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d78ffb-f1e8-466e-ac76-4c06c930d937 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:24.569096 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a96822-b686-4666-9ca2-b1bd595d1344 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:24.618552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52cd5c-c549-4a52-9ee3-f4212ea0600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:24.618552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52cd5c-c549-4a52-9ee3-f4212ea0600c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.618552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52cd5c-c549-4a52-9ee3-f4212ea0600c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.618552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52cd5c-c549-4a52-9ee3-f4212ea0600c None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.618911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52cd5c-c549-4a52-9ee3-f4212ea0600c None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:24.618911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52cd5c-c549-4a52-9ee3-f4212ea0600c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:24.619736 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52cd5c-c549-4a52-9ee3-f4212ea0600c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:24.632179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 67/140] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:24.633612 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7edf8-9923-4325-a400-dbac06673f76 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.633915 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7edf8-9923-4325-a400-dbac06673f76 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.634201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7edf8-9923-4325-a400-dbac06673f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.655824 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-21e7edf8-9923-4325-a400-dbac06673f76 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:24.657033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-21e7edf8-9923-4325-a400-dbac06673f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:24.711929 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:24.743042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:24.751473 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 68/141] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:24.753295 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7edf8-9923-4325-a400-dbac06673f76 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:24.813931 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d78ffb-f1e8-466e-ac76-4c06c930d937 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:24.861050 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09d11d-f53c-4dfd-9814-585b256fa05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:24.862787 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09d11d-f53c-4dfd-9814-585b256fa05d None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.863928 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09d11d-f53c-4dfd-9814-585b256fa05d None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.864234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09d11d-f53c-4dfd-9814-585b256fa05d None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.865497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09d11d-f53c-4dfd-9814-585b256fa05d None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:24.867023 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09d11d-f53c-4dfd-9814-585b256fa05d None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:24.868808 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 74/142] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:24 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:24.870056 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09d11d-f53c-4dfd-9814-585b256fa05d None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:24.897200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7edf8-9923-4325-a400-dbac06673f76 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:24.935477 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211af26-28f2-47d2-bc94-75cc6df73899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:24.936743 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211af26-28f2-47d2-bc94-75cc6df73899 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:24.937269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211af26-28f2-47d2-bc94-75cc6df73899 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:24.937719 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211af26-28f2-47d2-bc94-75cc6df73899 None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:24.939246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211af26-28f2-47d2-bc94-75cc6df73899 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:24.941609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211af26-28f2-47d2-bc94-75cc6df73899 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:24.943687 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 69/143] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:24 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:24.944666 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211af26-28f2-47d2-bc94-75cc6df73899 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:24.995618 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09d11d-f53c-4dfd-9814-585b256fa05d None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:25.020245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:25.036300 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:25.042817 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c669e-c5c6-416d-8ce4-5c10517b536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:25.043623 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c669e-c5c6-416d-8ce4-5c10517b536a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:25.043918 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c669e-c5c6-416d-8ce4-5c10517b536a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:25.044202 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c669e-c5c6-416d-8ce4-5c10517b536a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:25.057852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211af26-28f2-47d2-bc94-75cc6df73899 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:25.059127 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c669e-c5c6-416d-8ce4-5c10517b536a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-964c669e-c5c6-416d-8ce4-5c10517b536a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:25.068573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:25.069471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:25.070229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 75/144] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:25.070969 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c669e-c5c6-416d-8ce4-5c10517b536a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:25.103289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:25.104248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:25.104706 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:25.105123 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:25.106235 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] RBAC: Adding query filter params (role.id=da936e597e164c0e9a53de44f160bc12, scope.project.id=d5c2839cdfc7453089ac16e62f08a110, user.id=1097abebec5343b0b8adcc546fd59cfa) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:25.107292 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:25.109035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:25.115963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 70/145] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:24 2022] GET /identity/v3/role_assignments?user.id=1097abebec5343b0b8adcc546fd59cfa&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=da936e597e164c0e9a53de44f160bc12 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:25.116949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:25.238147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c669e-c5c6-416d-8ce4-5c10517b536a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:25.261269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad94226-c430-4136-ad55-ae48c7b191d5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:25.298690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:25.306710 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:25.307633 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:25.308102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:25.308535 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:25.309456 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:25.309921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:25.311753 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:25.324750 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 71/146] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:25.330523 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cae6b-0c47-4453-8ee0-534e180ffda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:25.330817 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cae6b-0c47-4453-8ee0-534e180ffda8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:25.331104 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cae6b-0c47-4453-8ee0-534e180ffda8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:25.331581 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cae6b-0c47-4453-8ee0-534e180ffda8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:25.334893 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:25.454926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:25.462585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cae6b-0c47-4453-8ee0-534e180ffda8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:25.464366 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cae6b-0c47-4453-8ee0-534e180ffda8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:25.590600 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 76/147] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:25.597272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cae6b-0c47-4453-8ee0-534e180ffda8 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:25.633139 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ad87c-ce00-48b7-950c-f6f7e821edea None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:25.694921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:25.706613 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cae6b-0c47-4453-8ee0-534e180ffda8 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:25.745194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c2f36-5c49-40fc-9a28-5ddb480ccd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:25.746436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c2f36-5c49-40fc-9a28-5ddb480ccd45 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:25.746889 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c2f36-5c49-40fc-9a28-5ddb480ccd45 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:25.747414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c2f36-5c49-40fc-9a28-5ddb480ccd45 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:25.748753 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c2f36-5c49-40fc-9a28-5ddb480ccd45 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:25.750368 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c2f36-5c49-40fc-9a28-5ddb480ccd45 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:25.753098 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 77/148] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:25 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:25.759248 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c2f36-5c49-40fc-9a28-5ddb480ccd45 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:25.759490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07cb2e-0429-406b-97b8-2789e1b5cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:25.760389 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07cb2e-0429-406b-97b8-2789e1b5cdae None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:25.760676 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07cb2e-0429-406b-97b8-2789e1b5cdae None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:25.760953 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07cb2e-0429-406b-97b8-2789e1b5cdae None admin] PATH_INFO: `/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:25.763248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07cb2e-0429-406b-97b8-2789e1b5cdae None admin] RBAC: Authorizing `identity:get_user(user_id=c2c0cf22337e45c78e8cb5635c37dbcb)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:25.764779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07cb2e-0429-406b-97b8-2789e1b5cdae None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:25.766563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 72/149] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:25 2022] GET /identity/v3/users/c2c0cf22337e45c78e8cb5635c37dbcb => generated 247 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:25.775365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07cb2e-0429-406b-97b8-2789e1b5cdae None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:25.906968 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c2f36-5c49-40fc-9a28-5ddb480ccd45 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:25.929379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:25.973310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b84eb0-e515-4fe3-8ddc-f8f9a7720f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:25.973972 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b84eb0-e515-4fe3-8ddc-f8f9a7720f8d None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:25.974254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b84eb0-e515-4fe3-8ddc-f8f9a7720f8d None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:25.974544 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b84eb0-e515-4fe3-8ddc-f8f9a7720f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:25.975382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b84eb0-e515-4fe3-8ddc-f8f9a7720f8d None admin] RBAC: Adding query filter params (role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=d5c2839cdfc7453089ac16e62f08a110, user.id=d7bdcb82cda748ea91e11af6871a68bf) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:25.975690 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b84eb0-e515-4fe3-8ddc-f8f9a7720f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:25.977132 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b84eb0-e515-4fe3-8ddc-f8f9a7720f8d None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:25.987829 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 78/150] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:25 2022] GET /identity/v3/role_assignments?user.id=d7bdcb82cda748ea91e11af6871a68bf&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:25.997600 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07cb2e-0429-406b-97b8-2789e1b5cdae None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:26.041604 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af6001-c3c6-4235-9e2a-a4c6e3da72b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:26.042265 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6001-c3c6-4235-9e2a-a4c6e3da72b3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:26.042569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6001-c3c6-4235-9e2a-a4c6e3da72b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:26.042848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6001-c3c6-4235-9e2a-a4c6e3da72b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:26.094262 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11783f-056d-4b1d-b659-73fd19f33810 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:26.094790 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11783f-056d-4b1d-b659-73fd19f33810 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:26.094860 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11783f-056d-4b1d-b659-73fd19f33810 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:26.096937 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 79/151] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:32:26.102747 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f66a8b-28ff-499a-b501-5656d1d086d9 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:26.103029 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f66a8b-28ff-499a-b501-5656d1d086d9 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:26.103299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f66a8b-28ff-499a-b501-5656d1d086d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:26.130620 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-28f66a8b-28ff-499a-b501-5656d1d086d9 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:26.131817 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-28f66a8b-28ff-499a-b501-5656d1d086d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:26.169221 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af6001-c3c6-4235-9e2a-a4c6e3da72b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:26.172052 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:26.177166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af6001-c3c6-4235-9e2a-a4c6e3da72b3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:26.265062 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 80/152] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 09:32:26.289368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:26.307570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f66a8b-28ff-499a-b501-5656d1d086d9 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:26.342108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 73/153] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:26.348779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af6001-c3c6-4235-9e2a-a4c6e3da72b3 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:26.477400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af6001-c3c6-4235-9e2a-a4c6e3da72b3 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:26.485527 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f66a8b-28ff-499a-b501-5656d1d086d9 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:26.518313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca781e-97f6-4daf-80d9-8951af35503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:26.519288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca781e-97f6-4daf-80d9-8951af35503a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:26.519669 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca781e-97f6-4daf-80d9-8951af35503a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:26.519950 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca781e-97f6-4daf-80d9-8951af35503a None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:26.521271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca781e-97f6-4daf-80d9-8951af35503a None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:26.522903 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca781e-97f6-4daf-80d9-8951af35503a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:26.524602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 74/154] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:26 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:26.534274 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca781e-97f6-4daf-80d9-8951af35503a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:26.550583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e06e16-02e9-4d39-a3e9-45ec9b1e27a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:26.551411 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06e16-02e9-4d39-a3e9-45ec9b1e27a2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:26.551698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06e16-02e9-4d39-a3e9-45ec9b1e27a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:26.551974 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06e16-02e9-4d39-a3e9-45ec9b1e27a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:26.578148 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e06e16-02e9-4d39-a3e9-45ec9b1e27a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:26.594825 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-29e06e16-02e9-4d39-a3e9-45ec9b1e27a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:26.597133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:26.597963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:26.598756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:26.607978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 81/155] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:26.614713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e06e16-02e9-4d39-a3e9-45ec9b1e27a2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:26.632473 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:26.734575 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca781e-97f6-4daf-80d9-8951af35503a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:26.792363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:26.793035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:26.793323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:26.793606 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:26.794451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=d5c2839cdfc7453089ac16e62f08a110, user.id=c2c0cf22337e45c78e8cb5635c37dbcb) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:26.796607 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:26.798094 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:26.805762 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 75/156] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:26 2022] GET /identity/v3/role_assignments?user.id=c2c0cf22337e45c78e8cb5635c37dbcb&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=bd8b88fae376413398183761500b2e1d => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:26.818134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e06e16-02e9-4d39-a3e9-45ec9b1e27a2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:26.869172 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459be3f-b0aa-4c90-a9c8-ea427bf548b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:26.869864 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459be3f-b0aa-4c90-a9c8-ea427bf548b4 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:26.870152 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459be3f-b0aa-4c90-a9c8-ea427bf548b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:26.870436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459be3f-b0aa-4c90-a9c8-ea427bf548b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:26.871227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459be3f-b0aa-4c90-a9c8-ea427bf548b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:26.871540 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459be3f-b0aa-4c90-a9c8-ea427bf548b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:26.872965 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459be3f-b0aa-4c90-a9c8-ea427bf548b4 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:26.893283 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 82/157] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:26.899130 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:27.059789 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e004b-df45-4478-b484-9299538ba85a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.060118 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e004b-df45-4478-b484-9299538ba85a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.060368 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e004b-df45-4478-b484-9299538ba85a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.061781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 83/158] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:27.061961 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:27.070083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0355-4ebf-4988-8933-70675eb220c9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:27.080735 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8defe73-25cd-4df2-873d-555cef79f8d1 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.081073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8defe73-25cd-4df2-873d-555cef79f8d1 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.081385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8defe73-25cd-4df2-873d-555cef79f8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.123148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f123-e8ad-411c-8a35-5f4c68b79faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:27.124051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f123-e8ad-411c-8a35-5f4c68b79faf None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.124338 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f123-e8ad-411c-8a35-5f4c68b79faf None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.124624 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f123-e8ad-411c-8a35-5f4c68b79faf None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.126084 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-e8defe73-25cd-4df2-873d-555cef79f8d1 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:27.128059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-e8defe73-25cd-4df2-873d-555cef79f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:27.129035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2f123-e8ad-411c-8a35-5f4c68b79faf None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:27.130540 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2f123-e8ad-411c-8a35-5f4c68b79faf None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:27.132253 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 76/159] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:26 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:27.137730 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f123-e8ad-411c-8a35-5f4c68b79faf None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:27.241199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 84/160] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:27.279573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8defe73-25cd-4df2-873d-555cef79f8d1 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:27.291180 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:27.295848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f123-e8ad-411c-8a35-5f4c68b79faf None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:27.340512 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae5e97-8335-41d8-a60a-7246536cb570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:27.341329 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5e97-8335-41d8-a60a-7246536cb570 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.341715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5e97-8335-41d8-a60a-7246536cb570 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.342094 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5e97-8335-41d8-a60a-7246536cb570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.389407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:27.426499 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8defe73-25cd-4df2-873d-555cef79f8d1 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:27.444407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae5e97-8335-41d8-a60a-7246536cb570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:27.446083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae5e97-8335-41d8-a60a-7246536cb570 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:27.466669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30287a15-1bba-4f6a-9902-3f52fe10cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:27.467612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287a15-1bba-4f6a-9902-3f52fe10cf0b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.468381 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287a15-1bba-4f6a-9902-3f52fe10cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.468381 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30287a15-1bba-4f6a-9902-3f52fe10cf0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.469763 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30287a15-1bba-4f6a-9902-3f52fe10cf0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:27.472311 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30287a15-1bba-4f6a-9902-3f52fe10cf0b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:27.474170 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 85/161] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:27.479823 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30287a15-1bba-4f6a-9902-3f52fe10cf0b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:27.552439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 77/162] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 09:32:27.554055 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5fe5a-0d9c-4e14-a3d0-13011416f7ba None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.554354 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5fe5a-0d9c-4e14-a3d0-13011416f7ba None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.554738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5fe5a-0d9c-4e14-a3d0-13011416f7ba None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.556244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 78/163] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:27.557775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5fe5a-0d9c-4e14-a3d0-13011416f7ba None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:27.569323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:27.598984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30287a15-1bba-4f6a-9902-3f52fe10cf0b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:27.622703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:27.638612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b05a9-79b1-4a53-a1c2-57c9f018d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:27.639295 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b05a9-79b1-4a53-a1c2-57c9f018d75c None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.639577 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b05a9-79b1-4a53-a1c2-57c9f018d75c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.640213 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b05a9-79b1-4a53-a1c2-57c9f018d75c None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.640943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b05a9-79b1-4a53-a1c2-57c9f018d75c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:27.643613 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b05a9-79b1-4a53-a1c2-57c9f018d75c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:27.664138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5fe5a-0d9c-4e14-a3d0-13011416f7ba None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:27.696304 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f1835-bf33-41da-afe1-3e1a6966dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:27.697167 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f1835-bf33-41da-afe1-3e1a6966dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.697452 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f1835-bf33-41da-afe1-3e1a6966dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.697729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f1835-bf33-41da-afe1-3e1a6966dfc3 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.698940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f1835-bf33-41da-afe1-3e1a6966dfc3 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:27.700405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f1835-bf33-41da-afe1-3e1a6966dfc3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:27.702108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 79/164] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:27 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:27.703419 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed62a27-1fc1-4340-803b-1691667b12a2 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.703715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed62a27-1fc1-4340-803b-1691667b12a2 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.703993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed62a27-1fc1-4340-803b-1691667b12a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.729923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-eed62a27-1fc1-4340-803b-1691667b12a2 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:27.731142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-eed62a27-1fc1-4340-803b-1691667b12a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:27.797670 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 80/165] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:27.798549 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed62a27-1fc1-4340-803b-1691667b12a2 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:27.826517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 86/166] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:32:27 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:32:27.827739 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b05a9-79b1-4a53-a1c2-57c9f018d75c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:27.875010 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:27.921693 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed62a27-1fc1-4340-803b-1691667b12a2 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:27.962055 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bce596-3977-4206-82f5-806587286fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:27.962885 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bce596-3977-4206-82f5-806587286fbd None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:27.963171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bce596-3977-4206-82f5-806587286fbd None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:27.963451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bce596-3977-4206-82f5-806587286fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:27.964320 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bce596-3977-4206-82f5-806587286fbd None admin] RBAC: Adding query filter params (role.id=fdcb4b876026440b87d75e4de6fdedcd, scope.project.id=d5c2839cdfc7453089ac16e62f08a110, user.id=d7bdcb82cda748ea91e11af6871a68bf) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:27.965020 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bce596-3977-4206-82f5-806587286fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:27.966204 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bce596-3977-4206-82f5-806587286fbd None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:27.974514 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 81/167] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:27 2022] GET /identity/v3/role_assignments?user.id=d7bdcb82cda748ea91e11af6871a68bf&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=fdcb4b876026440b87d75e4de6fdedcd => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:27.980926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b05a9-79b1-4a53-a1c2-57c9f018d75c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:28.024281 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:28.030522 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bb056-3a67-4c1e-96ea-d14d73f5a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:28.031377 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bb056-3a67-4c1e-96ea-d14d73f5a511 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:28.038667 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bb056-3a67-4c1e-96ea-d14d73f5a511 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:28.038667 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bb056-3a67-4c1e-96ea-d14d73f5a511 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:28.046126 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bb056-3a67-4c1e-96ea-d14d73f5a511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-639bb056-3a67-4c1e-96ea-d14d73f5a511 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:28.054838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:28.055877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:28.057075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 87/168] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:28.063391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bce596-3977-4206-82f5-806587286fbd None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:28.185724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bce596-3977-4206-82f5-806587286fbd None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:28.214268 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:28.226958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9511809-ed9f-433c-ad93-99c262df4f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:28.227643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9511809-ed9f-433c-ad93-99c262df4f1b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:28.228287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9511809-ed9f-433c-ad93-99c262df4f1b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:28.228287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9511809-ed9f-433c-ad93-99c262df4f1b None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:28.228954 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9511809-ed9f-433c-ad93-99c262df4f1b None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:28.229263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9511809-ed9f-433c-ad93-99c262df4f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:28.230753 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9511809-ed9f-433c-ad93-99c262df4f1b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:28.237088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa015-f05a-4520-b170-fc860316a1ab None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:28.237576 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa015-f05a-4520-b170-fc860316a1ab None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:28.237576 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa015-f05a-4520-b170-fc860316a1ab None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:28.240208 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 82/170] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:28.243160 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 88/170] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:28.244446 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbd00-9686-4f6a-8f4f-56406f6f25d0 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:28.244790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbd00-9686-4f6a-8f4f-56406f6f25d0 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:28.245017 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cbd00-9686-4f6a-8f4f-56406f6f25d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:28.248740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fa015-f05a-4520-b170-fc860316a1ab None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:28.270824 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-544cbd00-9686-4f6a-8f4f-56406f6f25d0 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:28.274699 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-544cbd00-9686-4f6a-8f4f-56406f6f25d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:28.368313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 83/171] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:28.397171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cbd00-9686-4f6a-8f4f-56406f6f25d0 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:28.405114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fa015-f05a-4520-b170-fc860316a1ab None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:28.455447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e85c-dd82-4a84-8a9c-b6d7d221adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:28.456259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e85c-dd82-4a84-8a9c-b6d7d221adbb None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:28.456592 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e85c-dd82-4a84-8a9c-b6d7d221adbb None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:28.456880 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e85c-dd82-4a84-8a9c-b6d7d221adbb None admin] PATH_INFO: `/v3/users/d7bdcb82cda748ea91e11af6871a68bf` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:28.458410 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345e85c-dd82-4a84-8a9c-b6d7d221adbb None admin] RBAC: Authorizing `identity:get_user(user_id=d7bdcb82cda748ea91e11af6871a68bf)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:28.460605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345e85c-dd82-4a84-8a9c-b6d7d221adbb None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:28.462260 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 89/172] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:28 2022] GET /identity/v3/users/d7bdcb82cda748ea91e11af6871a68bf => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:28.468158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e85c-dd82-4a84-8a9c-b6d7d221adbb None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:28.534616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cbd00-9686-4f6a-8f4f-56406f6f25d0 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:28.546619 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:28.561912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:28.591139 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0bf03-1a52-4c7d-b3b2-a64e407fa44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:28.592240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0bf03-1a52-4c7d-b3b2-a64e407fa44a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:28.592533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0bf03-1a52-4c7d-b3b2-a64e407fa44a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:28.592813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0bf03-1a52-4c7d-b3b2-a64e407fa44a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:28.593667 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e85c-dd82-4a84-8a9c-b6d7d221adbb None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:28.612238 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0bf03-1a52-4c7d-b3b2-a64e407fa44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-4fd0bf03-1a52-4c7d-b3b2-a64e407fa44a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:28.620138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:28.621202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:28.622098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:28.622715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 84/173] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:32:28.633237 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0bf03-1a52-4c7d-b3b2-a64e407fa44a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:28.675336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965f83d-4e3e-4764-840f-ba5de42fcc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:28.676015 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f83d-4e3e-4764-840f-ba5de42fcc6a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:28.676297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f83d-4e3e-4764-840f-ba5de42fcc6a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:28.676570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f83d-4e3e-4764-840f-ba5de42fcc6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:28.790317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965f83d-4e3e-4764-840f-ba5de42fcc6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:28.792117 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965f83d-4e3e-4764-840f-ba5de42fcc6a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:28.801498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0bf03-1a52-4c7d-b3b2-a64e407fa44a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:28.868422 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:28.869374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:28.869814 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:28.870377 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:28.872000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:28.872771 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:28.875120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:28.889532 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:28.896666 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 85/174] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:28.903493 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:28.942031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 90/175] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 09:32:28.949305 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965f83d-4e3e-4764-840f-ba5de42fcc6a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:28.985874 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:29.078258 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7945c42-f02a-493e-8c1d-10bfe7a53461 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:29.140822 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4680cc-9c77-42ea-9056-bde5b92fa702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:29.141705 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4680cc-9c77-42ea-9056-bde5b92fa702 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:29.141992 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4680cc-9c77-42ea-9056-bde5b92fa702 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:29.142271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4680cc-9c77-42ea-9056-bde5b92fa702 None admin] PATH_INFO: `/v3/users/1097abebec5343b0b8adcc546fd59cfa` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:29.145240 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965f83d-4e3e-4764-840f-ba5de42fcc6a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:29.147276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4680cc-9c77-42ea-9056-bde5b92fa702 None admin] RBAC: Authorizing `identity:get_user(user_id=1097abebec5343b0b8adcc546fd59cfa)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:29.148805 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4680cc-9c77-42ea-9056-bde5b92fa702 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:29.154526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 86/176] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:28 2022] GET /identity/v3/users/1097abebec5343b0b8adcc546fd59cfa => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:29.157204 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4680cc-9c77-42ea-9056-bde5b92fa702 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:29.222877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124a086-0d6e-46b7-be2e-01799258a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:29.223757 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a086-0d6e-46b7-be2e-01799258a073 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:29.224044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a086-0d6e-46b7-be2e-01799258a073 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:29.224936 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a086-0d6e-46b7-be2e-01799258a073 None admin] PATH_INFO: `/v3/projects/70f7a0a476d546298c8d76ee28980c42` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:29.228326 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124a086-0d6e-46b7-be2e-01799258a073 None admin] RBAC: Authorizing `identity:get_project(project_id=70f7a0a476d546298c8d76ee28980c42)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:29.229807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124a086-0d6e-46b7-be2e-01799258a073 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:29.231593 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 91/177] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:28 2022] GET /identity/v3/projects/70f7a0a476d546298c8d76ee28980c42 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:29.240322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124a086-0d6e-46b7-be2e-01799258a073 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:29.298843 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:29.373287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4680cc-9c77-42ea-9056-bde5b92fa702 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:29.390214 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:29.428358 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124a086-0d6e-46b7-be2e-01799258a073 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:29.468328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b674ae-f14e-4d90-8c09-c39e3650c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:29.468997 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b674ae-f14e-4d90-8c09-c39e3650c50c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:29.469287 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b674ae-f14e-4d90-8c09-c39e3650c50c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:29.469594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b674ae-f14e-4d90-8c09-c39e3650c50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:29.470434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b674ae-f14e-4d90-8c09-c39e3650c50c None admin] RBAC: Adding query filter params (role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=70f7a0a476d546298c8d76ee28980c42, user.id=d7bdcb82cda748ea91e11af6871a68bf) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:29.471303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b674ae-f14e-4d90-8c09-c39e3650c50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:29.473580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b674ae-f14e-4d90-8c09-c39e3650c50c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:29.478771 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b0e2-9fe9-4fbf-b003-18efb400b606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:29.479646 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b0e2-9fe9-4fbf-b003-18efb400b606 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:29.479934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b0e2-9fe9-4fbf-b003-18efb400b606 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:29.480215 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b0e2-9fe9-4fbf-b003-18efb400b606 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:29.481451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0b0e2-9fe9-4fbf-b003-18efb400b606 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:29.482948 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0b0e2-9fe9-4fbf-b003-18efb400b606 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:29.484658 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 87/178] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:29 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:29.489661 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 92/179] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:29 2022] GET /identity/v3/role_assignments?user.id=d7bdcb82cda748ea91e11af6871a68bf&scope.project.id=70f7a0a476d546298c8d76ee28980c42&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:29.504700 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b0e2-9fe9-4fbf-b003-18efb400b606 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:29.668797 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b0e2-9fe9-4fbf-b003-18efb400b606 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:29.719515 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504db73-228d-4825-b917-3dda0aeacc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:29.720422 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504db73-228d-4825-b917-3dda0aeacc5d None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:29.721269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504db73-228d-4825-b917-3dda0aeacc5d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:29.721558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504db73-228d-4825-b917-3dda0aeacc5d None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110/users/1097abebec5343b0b8adcc546fd59cfa/roles/da936e597e164c0e9a53de44f160bc12` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:29.723731 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504db73-228d-4825-b917-3dda0aeacc5d None admin] RBAC: Authorizing `identity:create_grant(project_id=d5c2839cdfc7453089ac16e62f08a110, user_id=1097abebec5343b0b8adcc546fd59cfa, role_id=da936e597e164c0e9a53de44f160bc12)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:29.725200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504db73-228d-4825-b917-3dda0aeacc5d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:29.804085 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 88/180] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:29 2022] PUT /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110/users/1097abebec5343b0b8adcc546fd59cfa/roles/da936e597e164c0e9a53de44f160bc12 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:30.530319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfe92-4371-46d3-9120-3bace6c596b4 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:30.530848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfe92-4371-46d3-9120-3bace6c596b4 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:30.530920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfe92-4371-46d3-9120-3bace6c596b4 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:30.532463 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 93/181] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:30.538492 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4b95-3e42-481c-9ae3-afc1a70a855e None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:30.541134 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4b95-3e42-481c-9ae3-afc1a70a855e None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:30.541134 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4b95-3e42-481c-9ae3-afc1a70a855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:30.558369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-a41c4b95-3e42-481c-9ae3-afc1a70a855e None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:30.559647 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-a41c4b95-3e42-481c-9ae3-afc1a70a855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:30.588194 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:30.634059 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 89/182] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:30.659076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cfe92-4371-46d3-9120-3bace6c596b4 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:30.756010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:30.769293 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cfe92-4371-46d3-9120-3bace6c596b4 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:30.806303 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068298-fde3-415e-891f-b99df6e63846 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:30.806664 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068298-fde3-415e-891f-b99df6e63846 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:30.806908 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb068298-fde3-415e-891f-b99df6e63846 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:30.808907 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 90/183] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:30.810334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68e8b0-f0a0-4db4-af8e-7e1f74690d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:30.811375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68e8b0-f0a0-4db4-af8e-7e1f74690d53 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:30.811855 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68e8b0-f0a0-4db4-af8e-7e1f74690d53 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:30.812343 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68e8b0-f0a0-4db4-af8e-7e1f74690d53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:30.814345 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d46eb6-4d73-4988-b1ff-83a089b8cc5f None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:30.814696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d46eb6-4d73-4988-b1ff-83a089b8cc5f None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:30.815042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d46eb6-4d73-4988-b1ff-83a089b8cc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:30.827461 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68e8b0-f0a0-4db4-af8e-7e1f74690d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:30.836852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-71d46eb6-4d73-4988-b1ff-83a089b8cc5f None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:30.836852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-71d46eb6-4d73-4988-b1ff-83a089b8cc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1c68e8b0-f0a0-4db4-af8e-7e1f74690d53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:30.837560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:30.838462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:30.839275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:30.841870 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 94/184] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:30.849763 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68e8b0-f0a0-4db4-af8e-7e1f74690d53 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:30.925001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 91/185] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:30.932718 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a096b-4910-4cfd-b085-2929de146e93 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:30.933043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a096b-4910-4cfd-b085-2929de146e93 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:30.933599 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a096b-4910-4cfd-b085-2929de146e93 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:30.935296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 92/186] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:30.941014 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8f95-adb8-49a9-8deb-60e5bfb51213 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:30.941383 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8f95-adb8-49a9-8deb-60e5bfb51213 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:30.942544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8f95-adb8-49a9-8deb-60e5bfb51213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:30.964433 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-299b8f95-adb8-49a9-8deb-60e5bfb51213 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:30.965723 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-299b8f95-adb8-49a9-8deb-60e5bfb51213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:30.979669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68e8b0-f0a0-4db4-af8e-7e1f74690d53 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.020351 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.021057 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.021348 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.021629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.022402 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:31.022752 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:31.024194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:31.033931 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 95/187] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:31.039153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.040308 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 93/188] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:31.041090 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b8f95-adb8-49a9-8deb-60e5bfb51213 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.057558 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:31.072113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:31.149657 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b8f95-adb8-49a9-8deb-60e5bfb51213 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.150016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0cd48-22fc-47f0-9cf0-65b410e2d620 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.186870 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f0cab-bc66-41d0-b34b-40ae196cf5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.187302 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118f813-3c54-4ef7-8ab7-6c3b8a8b905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.187889 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f0cab-bc66-41d0-b34b-40ae196cf5b2 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.188114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118f813-3c54-4ef7-8ab7-6c3b8a8b905a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.188251 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f0cab-bc66-41d0-b34b-40ae196cf5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.188402 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118f813-3c54-4ef7-8ab7-6c3b8a8b905a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.188681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118f813-3c54-4ef7-8ab7-6c3b8a8b905a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.188771 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f0cab-bc66-41d0-b34b-40ae196cf5b2 None admin] PATH_INFO: `/v3/users/a8590df7ef064b3ea394f517bc833db5` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.201663 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118f813-3c54-4ef7-8ab7-6c3b8a8b905a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:31.202951 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f0cab-bc66-41d0-b34b-40ae196cf5b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a8590df7ef064b3ea394f517bc833db5)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:31.204428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f0cab-bc66-41d0-b34b-40ae196cf5b2 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:31.211532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 94/189] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/users/a8590df7ef064b3ea394f517bc833db5 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:31.211532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f0cab-bc66-41d0-b34b-40ae196cf5b2 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-2118f813-3c54-4ef7-8ab7-6c3b8a8b905a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:31.211715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:31.212546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:31.213406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 96/190] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:31.214054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118f813-3c54-4ef7-8ab7-6c3b8a8b905a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.292659 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:31.305366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:31.323381 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118f813-3c54-4ef7-8ab7-6c3b8a8b905a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.326089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f0cab-bc66-41d0-b34b-40ae196cf5b2 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.360934 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55ab3-0168-45f7-8174-f3c0a08a0566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.361889 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55ab3-0168-45f7-8174-f3c0a08a0566 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.362174 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55ab3-0168-45f7-8174-f3c0a08a0566 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.362446 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55ab3-0168-45f7-8174-f3c0a08a0566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.368657 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232d62d-8ca1-4462-bbea-0b16e270c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.369459 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232d62d-8ca1-4462-bbea-0b16e270c6de None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.369744 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232d62d-8ca1-4462-bbea-0b16e270c6de None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.370021 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232d62d-8ca1-4462-bbea-0b16e270c6de None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.371208 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232d62d-8ca1-4462-bbea-0b16e270c6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:31.372722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232d62d-8ca1-4462-bbea-0b16e270c6de None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:31.374536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 95/191] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:31.375191 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232d62d-8ca1-4462-bbea-0b16e270c6de None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.448185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55ab3-0168-45f7-8174-f3c0a08a0566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:31.450826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55ab3-0168-45f7-8174-f3c0a08a0566 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:31.478202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232d62d-8ca1-4462-bbea-0b16e270c6de None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.512539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.513209 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.513490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.513760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.514528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:31.514838 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:31.516216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:31.525051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 96/192] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:31.525737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.529528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:31.543134 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:31.567397 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 97/193] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:31.568254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55ab3-0168-45f7-8174-f3c0a08a0566 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.636949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22fdf0-6910-47e6-acb4-e963b8a56d77 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.675681 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e04be4-52c2-4d5c-8003-748eb5fde4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.676354 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e04be4-52c2-4d5c-8003-748eb5fde4cc None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.676645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e04be4-52c2-4d5c-8003-748eb5fde4cc None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.676925 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e04be4-52c2-4d5c-8003-748eb5fde4cc None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.677019 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55ab3-0168-45f7-8174-f3c0a08a0566 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.677639 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e04be4-52c2-4d5c-8003-748eb5fde4cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:31.679138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e04be4-52c2-4d5c-8003-748eb5fde4cc None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:31.713967 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad80a5-07a3-4f78-896a-69bfb4f4e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.714793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad80a5-07a3-4f78-896a-69bfb4f4e0ba None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.715074 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad80a5-07a3-4f78-896a-69bfb4f4e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.715343 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad80a5-07a3-4f78-896a-69bfb4f4e0ba None admin] PATH_INFO: `/v3/users/a8590df7ef064b3ea394f517bc833db5` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.716593 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad80a5-07a3-4f78-896a-69bfb4f4e0ba None admin] RBAC: Authorizing `identity:get_user(user_id=a8590df7ef064b3ea394f517bc833db5)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:31.718047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad80a5-07a3-4f78-896a-69bfb4f4e0ba None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:31.719717 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 98/194] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/users/a8590df7ef064b3ea394f517bc833db5 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:31.720542 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad80a5-07a3-4f78-896a-69bfb4f4e0ba None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.763424 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:31.787053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 97/195] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:32:31 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:31.787907 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e04be4-52c2-4d5c-8003-748eb5fde4cc None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.841869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad80a5-07a3-4f78-896a-69bfb4f4e0ba None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.886126 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1b30c-61dd-4962-b8db-546d7a79c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.887465 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1b30c-61dd-4962-b8db-546d7a79c027 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.887924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1b30c-61dd-4962-b8db-546d7a79c027 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.888525 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:31.889657 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1b30c-61dd-4962-b8db-546d7a79c027 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:31.891224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1b30c-61dd-4962-b8db-546d7a79c027 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:31.893539 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1b30c-61dd-4962-b8db-546d7a79c027 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:31.895721 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 99/196] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:31.901835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1b30c-61dd-4962-b8db-546d7a79c027 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:31.937748 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e04be4-52c2-4d5c-8003-748eb5fde4cc None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:31.987724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e1c01-748f-4eec-b947-31c23167e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:31.988608 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e1c01-748f-4eec-b947-31c23167e286 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:31.988898 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e1c01-748f-4eec-b947-31c23167e286 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:31.989179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e1c01-748f-4eec-b947-31c23167e286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.035063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1b30c-61dd-4962-b8db-546d7a79c027 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:32.050173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:32.082841 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264770e-4f01-4bc4-9369-4598b5da6246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:32.083834 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264770e-4f01-4bc4-9369-4598b5da6246 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:32.084299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264770e-4f01-4bc4-9369-4598b5da6246 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:32.084899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264770e-4f01-4bc4-9369-4598b5da6246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.086069 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264770e-4f01-4bc4-9369-4598b5da6246 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f, user.id=a8590df7ef064b3ea394f517bc833db5) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:32.086614 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264770e-4f01-4bc4-9369-4598b5da6246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:32.088519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264770e-4f01-4bc4-9369-4598b5da6246 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:32.094994 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 100/197] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/role_assignments?user.id=a8590df7ef064b3ea394f517bc833db5&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=bd8b88fae376413398183761500b2e1d => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:32.106060 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e1c01-748f-4eec-b947-31c23167e286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:32.107660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e1c01-748f-4eec-b947-31c23167e286 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:32.167452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae88c8e-ba8b-44db-84f8-15e7c965906c None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:32.167858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae88c8e-ba8b-44db-84f8-15e7c965906c None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:32.168064 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae88c8e-ba8b-44db-84f8-15e7c965906c None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.169614 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 101/198] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:32.176765 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a6cd-5bc0-4126-9c2b-b55984fa7fc9 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:32.177453 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a6cd-5bc0-4126-9c2b-b55984fa7fc9 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:32.177453 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a6cd-5bc0-4126-9c2b-b55984fa7fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.191459 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:32.207766 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-2518a6cd-5bc0-4126-9c2b-b55984fa7fc9 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:32.209026 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-2518a6cd-5bc0-4126-9c2b-b55984fa7fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:32.237248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 98/199] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:32.246202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e1c01-748f-4eec-b947-31c23167e286 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:32.306182 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 102/200] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:32.339569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518a6cd-5bc0-4126-9c2b-b55984fa7fc9 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:32.377328 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e1c01-748f-4eec-b947-31c23167e286 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:32.445968 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344adeb-82f7-428c-bb06-6558b438f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:32.446884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344adeb-82f7-428c-bb06-6558b438f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:32.447176 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344adeb-82f7-428c-bb06-6558b438f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:32.447460 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344adeb-82f7-428c-bb06-6558b438f5d5 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.448685 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344adeb-82f7-428c-bb06-6558b438f5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:32.450175 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344adeb-82f7-428c-bb06-6558b438f5d5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:32.453213 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 99/201] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:32 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:32.460070 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344adeb-82f7-428c-bb06-6558b438f5d5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:32.472636 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518a6cd-5bc0-4126-9c2b-b55984fa7fc9 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:32.474960 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:32.500350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:32.529923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2bb44-c578-4745-ba7e-86534abdde48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:32.531036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2bb44-c578-4745-ba7e-86534abdde48 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:32.531328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2bb44-c578-4745-ba7e-86534abdde48 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:32.531610 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2bb44-c578-4745-ba7e-86534abdde48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.549794 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2bb44-c578-4745-ba7e-86534abdde48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-eac2bb44-c578-4745-ba7e-86534abdde48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:32.557854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:32.558742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:32.559993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 103/202] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:32.569194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2bb44-c578-4745-ba7e-86534abdde48 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:32.634313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344adeb-82f7-428c-bb06-6558b438f5d5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:32.681165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2bb44-c578-4745-ba7e-86534abdde48 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:32.718270 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:32.718504 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:32.718981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:32.719092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:32.719259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:32.719357 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:32.719537 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.719649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.720288 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:32.720420 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] RBAC: Adding query filter params (role.id=fdcb4b876026440b87d75e4de6fdedcd, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f, user.id=a8590df7ef064b3ea394f517bc833db5) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:32.720673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:32.720773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:32.722134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:32.722240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:32.727960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 100/203] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:32 2022] GET /identity/v3/role_assignments?user.id=a8590df7ef064b3ea394f517bc833db5&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=fdcb4b876026440b87d75e4de6fdedcd => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:32.731435 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 104/204] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:32.737650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:32.898042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:32.901924 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ca595-8059-467f-9e87-d4d915b48754 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:32.940404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ff7f4-b9db-4eac-9b48-e8f173e9220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:32.941629 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ff7f4-b9db-4eac-9b48-e8f173e9220d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:32.942097 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ff7f4-b9db-4eac-9b48-e8f173e9220d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:32.942594 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ff7f4-b9db-4eac-9b48-e8f173e9220d None admin] PATH_INFO: `/v3/users/1097abebec5343b0b8adcc546fd59cfa` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:32.944149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ff7f4-b9db-4eac-9b48-e8f173e9220d None admin] RBAC: Authorizing `identity:get_user(user_id=1097abebec5343b0b8adcc546fd59cfa)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:32.945840 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ff7f4-b9db-4eac-9b48-e8f173e9220d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:32.947806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 101/205] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:32 2022] GET /identity/v3/users/1097abebec5343b0b8adcc546fd59cfa => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:32.954502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:32.999492 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:33.107679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7fa20-0c5f-4feb-89af-03f1f829607f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:33.153771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660fa7a-ab05-4704-bc8f-e1db6230daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:33.154366 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660fa7a-ab05-4704-bc8f-e1db6230daab None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:33.154685 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660fa7a-ab05-4704-bc8f-e1db6230daab None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:33.154972 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660fa7a-ab05-4704-bc8f-e1db6230daab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:33.247507 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660fa7a-ab05-4704-bc8f-e1db6230daab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:33.248980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660fa7a-ab05-4704-bc8f-e1db6230daab None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:33.288944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:33.402728 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 105/206] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:33.408665 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ff7f4-b9db-4eac-9b48-e8f173e9220d None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:33.569151 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ff7f4-b9db-4eac-9b48-e8f173e9220d None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:33.609213 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07de6d-cae1-41ed-ab9d-24b673ec8bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:33.610086 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07de6d-cae1-41ed-ab9d-24b673ec8bf0 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:33.610375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07de6d-cae1-41ed-ab9d-24b673ec8bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:33.610692 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07de6d-cae1-41ed-ab9d-24b673ec8bf0 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:33.612456 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07de6d-cae1-41ed-ab9d-24b673ec8bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:33.614091 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07de6d-cae1-41ed-ab9d-24b673ec8bf0 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:33.616312 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 102/207] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:33 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:33.628113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660fa7a-ab05-4704-bc8f-e1db6230daab None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:33.742564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660fa7a-ab05-4704-bc8f-e1db6230daab None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:33.767703 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:33.783203 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994724d6-cc71-49f1-a351-452e90750807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:33.784094 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994724d6-cc71-49f1-a351-452e90750807 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:33.784389 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994724d6-cc71-49f1-a351-452e90750807 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:33.784674 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994724d6-cc71-49f1-a351-452e90750807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:33.785522 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994724d6-cc71-49f1-a351-452e90750807 None admin] RBAC: Adding query filter params (role.id=da936e597e164c0e9a53de44f160bc12, scope.project.id=d5c2839cdfc7453089ac16e62f08a110, user.id=1097abebec5343b0b8adcc546fd59cfa) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:33.785841 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994724d6-cc71-49f1-a351-452e90750807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:33.787458 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994724d6-cc71-49f1-a351-452e90750807 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:33.799911 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 106/208] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:33 2022] GET /identity/v3/role_assignments?user.id=1097abebec5343b0b8adcc546fd59cfa&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=da936e597e164c0e9a53de44f160bc12 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:34.724573 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51488a-8506-4a04-ab35-d71e9dbd81e8 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:34.725111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51488a-8506-4a04-ab35-d71e9dbd81e8 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:34.725111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51488a-8506-4a04-ab35-d71e9dbd81e8 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:34.726690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 103/209] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:34.749813 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9aed8-1c96-413b-a21d-5e851d46368d None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:34.750625 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9aed8-1c96-413b-a21d-5e851d46368d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:34.750625 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9aed8-1c96-413b-a21d-5e851d46368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:34.787459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-38d9aed8-1c96-413b-a21d-5e851d46368d None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:34.787644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e854d4-4d68-42cd-a62b-60d2b4748c56 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:34.787644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e854d4-4d68-42cd-a62b-60d2b4748c56 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:34.787777 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-38d9aed8-1c96-413b-a21d-5e851d46368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:34.787872 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e854d4-4d68-42cd-a62b-60d2b4748c56 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:34.789532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 104/210] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:34.795628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0563-576c-4551-b546-6d22fde974cb None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:34.796139 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0563-576c-4551-b546-6d22fde974cb None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:34.796988 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0563-576c-4551-b546-6d22fde974cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:34.825028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-538b0563-576c-4551-b546-6d22fde974cb None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:34.834624 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-538b0563-576c-4551-b546-6d22fde974cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:34.870867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:34.878879 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 107/211] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:34.881321 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f142b22-f99b-4886-a26a-97d831cb8759 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:34.881848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f142b22-f99b-4886-a26a-97d831cb8759 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:34.882365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f142b22-f99b-4886-a26a-97d831cb8759 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:34.887626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 108/212] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:32:34.899379 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef949e-d274-4b03-b1ae-f9250e838583 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:34.899946 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef949e-d274-4b03-b1ae-f9250e838583 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:34.900454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef949e-d274-4b03-b1ae-f9250e838583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:34.922642 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-44ef949e-d274-4b03-b1ae-f9250e838583 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:34.924413 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-44ef949e-d274-4b03-b1ae-f9250e838583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:34.933418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 105/213] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:34.934384 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b0563-576c-4551-b546-6d22fde974cb None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.010867 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 109/214] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:35.010867 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef949e-d274-4b03-b1ae-f9250e838583 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.058086 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b0563-576c-4551-b546-6d22fde974cb None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.063496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:35.093687 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c73b5-9001-4fb1-8e90-88bc722c739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.094647 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c73b5-9001-4fb1-8e90-88bc722c739c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.094935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c73b5-9001-4fb1-8e90-88bc722c739c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.095215 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c73b5-9001-4fb1-8e90-88bc722c739c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.096435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c73b5-9001-4fb1-8e90-88bc722c739c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:35.097884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c73b5-9001-4fb1-8e90-88bc722c739c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:35.104145 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 106/215] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:35.104145 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c73b5-9001-4fb1-8e90-88bc722c739c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.127980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef949e-d274-4b03-b1ae-f9250e838583 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.140932 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:35.165863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efde3b4-e037-42d6-bad6-dd8c74cebaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.167113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efde3b4-e037-42d6-bad6-dd8c74cebaea None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.167695 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efde3b4-e037-42d6-bad6-dd8c74cebaea None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.167975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efde3b4-e037-42d6-bad6-dd8c74cebaea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.182700 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efde3b4-e037-42d6-bad6-dd8c74cebaea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-0efde3b4-e037-42d6-bad6-dd8c74cebaea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:35.192545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:35.193439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:35.194224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 110/216] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:35.194928 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efde3b4-e037-42d6-bad6-dd8c74cebaea None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.216979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c73b5-9001-4fb1-8e90-88bc722c739c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.256010 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15576d-7ec5-4fbc-9d01-427c15e69153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.256815 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15576d-7ec5-4fbc-9d01-427c15e69153 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.257102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15576d-7ec5-4fbc-9d01-427c15e69153 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.257379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15576d-7ec5-4fbc-9d01-427c15e69153 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.269324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15576d-7ec5-4fbc-9d01-427c15e69153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-6a15576d-7ec5-4fbc-9d01-427c15e69153 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:35.277299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:35.278200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:35.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 107/217] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:35.279656 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15576d-7ec5-4fbc-9d01-427c15e69153 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.308944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efde3b4-e037-42d6-bad6-dd8c74cebaea None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.319899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:35.348007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7514a-9851-4a94-96a3-8171bab7b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.348691 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7514a-9851-4a94-96a3-8171bab7b34f None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.348979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7514a-9851-4a94-96a3-8171bab7b34f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.349259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7514a-9851-4a94-96a3-8171bab7b34f None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.349994 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7514a-9851-4a94-96a3-8171bab7b34f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:35.351486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7514a-9851-4a94-96a3-8171bab7b34f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:35.391056 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:35.397703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15576d-7ec5-4fbc-9d01-427c15e69153 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.431707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.432370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.432657 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.432935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.433688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:35.433996 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:35.435424 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:35.444487 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 108/218] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:35.445291 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.484010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 111/219] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:32:35 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:35.484685 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7514a-9851-4a94-96a3-8171bab7b34f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.576554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c65735-58cb-4f2f-8fd8-a36dd892df03 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.619981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.621342 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.622334 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.623111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.624097 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:35.624879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:35.627392 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:35.628612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7514a-9851-4a94-96a3-8171bab7b34f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.640007 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 109/220] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:35.650602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.669581 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:35.678940 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f081b8-1f8c-45a9-847c-e10865ebb83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.679832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f081b8-1f8c-45a9-847c-e10865ebb83b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.680130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f081b8-1f8c-45a9-847c-e10865ebb83b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.680410 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f081b8-1f8c-45a9-847c-e10865ebb83b None admin] PATH_INFO: `/v3/users/a8590df7ef064b3ea394f517bc833db5` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.681697 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f081b8-1f8c-45a9-847c-e10865ebb83b None admin] RBAC: Authorizing `identity:get_user(user_id=a8590df7ef064b3ea394f517bc833db5)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:35.683265 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f081b8-1f8c-45a9-847c-e10865ebb83b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:35.685002 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 112/221] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:35 2022] GET /identity/v3/users/a8590df7ef064b3ea394f517bc833db5 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:35.686375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837392d-08bd-478b-a19b-a268904bfabb None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.686700 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837392d-08bd-478b-a19b-a268904bfabb None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.686984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837392d-08bd-478b-a19b-a268904bfabb None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.688235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 113/222] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:35.691410 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837392d-08bd-478b-a19b-a268904bfabb None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.728235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:35.766656 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900cdb4-281b-4480-922e-7dbb62e0a1ef None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.816731 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ebbc5-838d-4e4f-9e7a-d84ab96cfd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.817630 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ebbc5-838d-4e4f-9e7a-d84ab96cfd0e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.817914 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ebbc5-838d-4e4f-9e7a-d84ab96cfd0e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.818193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ebbc5-838d-4e4f-9e7a-d84ab96cfd0e None admin] PATH_INFO: `/v3/users/f1e85f2bdf784119bece81a0e8d0244e` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.825009 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837392d-08bd-478b-a19b-a268904bfabb None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:35.836214 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ebbc5-838d-4e4f-9e7a-d84ab96cfd0e None admin] RBAC: Authorizing `identity:get_user(user_id=f1e85f2bdf784119bece81a0e8d0244e)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:35.837639 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ebbc5-838d-4e4f-9e7a-d84ab96cfd0e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:35.839728 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 110/223] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:35 2022] GET /identity/v3/users/f1e85f2bdf784119bece81a0e8d0244e => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:35.840958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5315f-8fd0-4e62-a54e-bf7d09c85402 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.841242 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5315f-8fd0-4e62-a54e-bf7d09c85402 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.841523 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5315f-8fd0-4e62-a54e-bf7d09c85402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.862572 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-c7c5315f-8fd0-4e62-a54e-bf7d09c85402 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:35.863761 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-c7c5315f-8fd0-4e62-a54e-bf7d09c85402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:35.868680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3138dac-0823-488c-bdbe-95fc250611a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:35.869647 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3138dac-0823-488c-bdbe-95fc250611a8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:35.869939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3138dac-0823-488c-bdbe-95fc250611a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:35.870219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3138dac-0823-488c-bdbe-95fc250611a8 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:35.872980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3138dac-0823-488c-bdbe-95fc250611a8 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:35.874374 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3138dac-0823-488c-bdbe-95fc250611a8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:35.876334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 114/224] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:35 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:35.877551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3138dac-0823-488c-bdbe-95fc250611a8 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.944159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 111/225] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:35.949531 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5315f-8fd0-4e62-a54e-bf7d09c85402 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:35.963216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:35.998262 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:36.001606 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3138dac-0823-488c-bdbe-95fc250611a8 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:36.037259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e15c-f03f-41a5-a477-a927cf0abbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:36.037917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e15c-f03f-41a5-a477-a927cf0abbe8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:36.038198 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e15c-f03f-41a5-a477-a927cf0abbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:36.038495 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e15c-f03f-41a5-a477-a927cf0abbe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:36.090219 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5315f-8fd0-4e62-a54e-bf7d09c85402 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:36.128546 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ef719-29c6-4d03-a61d-ca78f8f35ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:36.129544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ef719-29c6-4d03-a61d-ca78f8f35ed7 None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:36.129873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ef719-29c6-4d03-a61d-ca78f8f35ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:36.130248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ef719-29c6-4d03-a61d-ca78f8f35ed7 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/users/a8590df7ef064b3ea394f517bc833db5/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:36.132367 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ef719-29c6-4d03-a61d-ca78f8f35ed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=688bf756f62c4e97a15b6887b5f90f2f, user_id=a8590df7ef064b3ea394f517bc833db5, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:36.132657 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6e15c-f03f-41a5-a477-a927cf0abbe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:36.133821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ef719-29c6-4d03-a61d-ca78f8f35ed7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:36.134156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6e15c-f03f-41a5-a477-a927cf0abbe8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:36.217734 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 112/226] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:35 2022] PUT /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/users/a8590df7ef064b3ea394f517bc833db5/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:36.218421 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ef719-29c6-4d03-a61d-ca78f8f35ed7 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:36.272074 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:36.280850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 115/227] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:36.287226 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e15c-f03f-41a5-a477-a927cf0abbe8 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:36.308046 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:36.354563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ef719-29c6-4d03-a61d-ca78f8f35ed7 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:36.401025 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bc870-bb66-4ae5-895d-04f49f6abd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:36.402172 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc870-bb66-4ae5-895d-04f49f6abd8e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:36.402460 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc870-bb66-4ae5-895d-04f49f6abd8e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:36.402769 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc870-bb66-4ae5-895d-04f49f6abd8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:36.417468 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bc870-bb66-4ae5-895d-04f49f6abd8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-929bc870-bb66-4ae5-895d-04f49f6abd8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:36.427223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:36.428179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:36.429326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 113/228] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:36.437142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bc870-bb66-4ae5-895d-04f49f6abd8e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:36.508272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e15c-f03f-41a5-a477-a927cf0abbe8 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:36.561224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4d70-1cf7-45ed-b1dd-05a02027d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:36.562149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4d70-1cf7-45ed-b1dd-05a02027d42e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:36.562448 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4d70-1cf7-45ed-b1dd-05a02027d42e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:36.562768 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4d70-1cf7-45ed-b1dd-05a02027d42e None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:36.564094 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4d70-1cf7-45ed-b1dd-05a02027d42e None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:36.565719 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4d70-1cf7-45ed-b1dd-05a02027d42e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:36.568618 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 116/229] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:36 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:36.574696 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4d70-1cf7-45ed-b1dd-05a02027d42e None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:36.600877 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bc870-bb66-4ae5-895d-04f49f6abd8e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:36.630503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:36.639712 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:36.640490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:36.644800 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:36.644800 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:36.644800 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:36.644800 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:36.645466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:36.652257 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:36.655662 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 114/230] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:36.661431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:36.687827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4d70-1cf7-45ed-b1dd-05a02027d42e None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:36.724760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:36.725432 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:36.725722 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:36.726049 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:36.726929 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] RBAC: Adding query filter params (role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f, user.id=f1e85f2bdf784119bece81a0e8d0244e) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:36.727247 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:36.728746 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:36.734612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 117/231] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:36 2022] GET /identity/v3/role_assignments?user.id=f1e85f2bdf784119bece81a0e8d0244e&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:36.771957 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d530cb7-7ade-4611-b11d-76a0baac1b3e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:36.811685 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b4a9-61eb-411d-83d7-f913eea1582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:36.812582 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b4a9-61eb-411d-83d7-f913eea1582b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:36.812866 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b4a9-61eb-411d-83d7-f913eea1582b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:36.813140 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979b4a9-61eb-411d-83d7-f913eea1582b None admin] PATH_INFO: `/v3/users/a8590df7ef064b3ea394f517bc833db5` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:36.814750 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979b4a9-61eb-411d-83d7-f913eea1582b None admin] RBAC: Authorizing `identity:get_user(user_id=a8590df7ef064b3ea394f517bc833db5)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:36.816351 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979b4a9-61eb-411d-83d7-f913eea1582b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:36.818428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 115/232] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:36 2022] GET /identity/v3/users/a8590df7ef064b3ea394f517bc833db5 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:36.824168 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:36.963989 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcdc64-f0ae-48c0-9712-b355be97e7cd None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:36.997199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:37.003315 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b4fc8-0e6b-46e2-a692-679c34666326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:37.004229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4fc8-0e6b-46e2-a692-679c34666326 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:37.013365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4fc8-0e6b-46e2-a692-679c34666326 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:37.013365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4fc8-0e6b-46e2-a692-679c34666326 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:37.013365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b4fc8-0e6b-46e2-a692-679c34666326 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:37.013365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b4fc8-0e6b-46e2-a692-679c34666326 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:37.013365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 118/233] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:36 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:37.015118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b4a9-61eb-411d-83d7-f913eea1582b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:37.101427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:37.156480 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979b4a9-61eb-411d-83d7-f913eea1582b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:37.203287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317b862-73a8-43b4-bdfb-f2d089f5cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:37.204604 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317b862-73a8-43b4-bdfb-f2d089f5cde9 None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:37.205153 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317b862-73a8-43b4-bdfb-f2d089f5cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:37.205825 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317b862-73a8-43b4-bdfb-f2d089f5cde9 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/users/a8590df7ef064b3ea394f517bc833db5/roles/fdcb4b876026440b87d75e4de6fdedcd` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:37.212328 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317b862-73a8-43b4-bdfb-f2d089f5cde9 None admin] RBAC: Authorizing `identity:create_grant(project_id=688bf756f62c4e97a15b6887b5f90f2f, user_id=a8590df7ef064b3ea394f517bc833db5, role_id=fdcb4b876026440b87d75e4de6fdedcd)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:37.214164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317b862-73a8-43b4-bdfb-f2d089f5cde9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:37.328926 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 116/234] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:37 2022] PUT /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/users/a8590df7ef064b3ea394f517bc833db5/roles/fdcb4b876026440b87d75e4de6fdedcd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:38.170299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68c057-e77d-4315-a049-99da79c66b41 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:38.170844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68c057-e77d-4315-a049-99da79c66b41 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:38.170920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68c057-e77d-4315-a049-99da79c66b41 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:38.172482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 119/235] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:38.178241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbca47-0e64-4ca0-a09d-72e764948ef2 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:38.178724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbca47-0e64-4ca0-a09d-72e764948ef2 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:38.178900 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbca47-0e64-4ca0-a09d-72e764948ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:38.199080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-d9fbca47-0e64-4ca0-a09d-72e764948ef2 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:38.200267 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-d9fbca47-0e64-4ca0-a09d-72e764948ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:38.273867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 117/236] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:38.298986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68c057-e77d-4315-a049-99da79c66b41 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:38.332087 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29dd98-42ea-4a68-9299-5ee0d6b08831 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:38.332405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29dd98-42ea-4a68-9299-5ee0d6b08831 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:38.332649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29dd98-42ea-4a68-9299-5ee0d6b08831 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:38.334029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 118/237] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:38.341884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95096bad-52ac-430f-8ae2-fbdb3b7f3859 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:38.342172 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95096bad-52ac-430f-8ae2-fbdb3b7f3859 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:38.342451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95096bad-52ac-430f-8ae2-fbdb3b7f3859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:38.374777 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-95096bad-52ac-430f-8ae2-fbdb3b7f3859 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:38.375964 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-95096bad-52ac-430f-8ae2-fbdb3b7f3859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:38.468433 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:38.479275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68c057-e77d-4315-a049-99da79c66b41 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:38.512738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 119/238] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:38.538396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95096bad-52ac-430f-8ae2-fbdb3b7f3859 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:38.542109 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d169f4-be8c-4ee4-82a7-eb23b1ee29d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:38.543219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d169f4-be8c-4ee4-82a7-eb23b1ee29d3 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:38.543707 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d169f4-be8c-4ee4-82a7-eb23b1ee29d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:38.544178 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d169f4-be8c-4ee4-82a7-eb23b1ee29d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:38.564686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d169f4-be8c-4ee4-82a7-eb23b1ee29d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-57d169f4-be8c-4ee4-82a7-eb23b1ee29d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:38.573595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:38.574545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:38.575336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:38.578038 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 120/239] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:38.585106 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d169f4-be8c-4ee4-82a7-eb23b1ee29d3 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:38.674845 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:38.721487 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d169f4-be8c-4ee4-82a7-eb23b1ee29d3 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:38.735435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95096bad-52ac-430f-8ae2-fbdb3b7f3859 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:38.770514 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:38.771203 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:38.771494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:38.771776 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:38.772530 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:38.772840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:38.774231 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:38.783799 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 121/240] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:38.795356 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:38.796778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475a8e-8e82-4e17-9309-5e04b11ee46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:38.797583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475a8e-8e82-4e17-9309-5e04b11ee46f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:38.797873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475a8e-8e82-4e17-9309-5e04b11ee46f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:38.798165 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475a8e-8e82-4e17-9309-5e04b11ee46f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:38.800120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475a8e-8e82-4e17-9309-5e04b11ee46f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:38.801583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475a8e-8e82-4e17-9309-5e04b11ee46f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:38.803271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 120/241] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:38.808577 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475a8e-8e82-4e17-9309-5e04b11ee46f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:38.878869 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:38.916685 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475a8e-8e82-4e17-9309-5e04b11ee46f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:38.953956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924c59-383a-416b-b3ed-9ee04f4b01f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:38.954811 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924c59-383a-416b-b3ed-9ee04f4b01f7 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:38.955234 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924c59-383a-416b-b3ed-9ee04f4b01f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:38.955521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924c59-383a-416b-b3ed-9ee04f4b01f7 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:38.956254 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924c59-383a-416b-b3ed-9ee04f4b01f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:38.957973 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924c59-383a-416b-b3ed-9ee04f4b01f7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:38.984473 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c893-af77-41da-92c2-2a4c11e19b93 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:39.006892 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:39.019092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447ff1b-ecad-41ec-ac93-d95632a1ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:39.020141 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447ff1b-ecad-41ec-ac93-d95632a1ee8b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.020354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447ff1b-ecad-41ec-ac93-d95632a1ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.020633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447ff1b-ecad-41ec-ac93-d95632a1ee8b None admin] PATH_INFO: `/v3/users/75c5659efa0b4c0d95065284d838f0d9` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.035353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447ff1b-ecad-41ec-ac93-d95632a1ee8b None admin] RBAC: Authorizing `identity:get_user(user_id=75c5659efa0b4c0d95065284d838f0d9)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:39.036900 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447ff1b-ecad-41ec-ac93-d95632a1ee8b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:39.039526 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 122/242] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:38 2022] GET /identity/v3/users/75c5659efa0b4c0d95065284d838f0d9 => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:39.040365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045f4d3-473a-451d-8222-bdc8893755c6 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.041934 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045f4d3-473a-451d-8222-bdc8893755c6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.041934 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045f4d3-473a-451d-8222-bdc8893755c6 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.042185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 123/243] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:39.047151 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045f4d3-473a-451d-8222-bdc8893755c6 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:39.057900 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 121/244] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:32:38 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:32:39.062690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ea18-235b-45d9-b6cc-f52e4ce494ef None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.062690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ea18-235b-45d9-b6cc-f52e4ce494ef None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.062690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ea18-235b-45d9-b6cc-f52e4ce494ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.090150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-2311ea18-235b-45d9-b6cc-f52e4ce494ef None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:39.091995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-2311ea18-235b-45d9-b6cc-f52e4ce494ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:39.204326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 122/245] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:39.232648 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ea18-235b-45d9-b6cc-f52e4ce494ef None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:39.271197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045f4d3-473a-451d-8222-bdc8893755c6 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:39.273776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:39.341348 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64452316-b62b-4c5f-aa69-60cd26bdd436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:39.342008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452316-b62b-4c5f-aa69-60cd26bdd436 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.342295 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452316-b62b-4c5f-aa69-60cd26bdd436 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.342634 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64452316-b62b-4c5f-aa69-60cd26bdd436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.354164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ea18-235b-45d9-b6cc-f52e4ce494ef None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:39.400559 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:39.403046 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425a287-5f88-4a98-85d1-b9a06e4e16c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:39.403884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425a287-5f88-4a98-85d1-b9a06e4e16c1 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.404173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425a287-5f88-4a98-85d1-b9a06e4e16c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.404446 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425a287-5f88-4a98-85d1-b9a06e4e16c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.421286 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425a287-5f88-4a98-85d1-b9a06e4e16c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:39.426144 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452316-b62b-4c5f-aa69-60cd26bdd436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:39.427701 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64452316-b62b-4c5f-aa69-60cd26bdd436 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-c425a287-5f88-4a98-85d1-b9a06e4e16c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:39.429942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:39.430879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:39.431649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 123/246] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:32:39.442038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425a287-5f88-4a98-85d1-b9a06e4e16c1 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:39.554367 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 124/247] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:39.560092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64452316-b62b-4c5f-aa69-60cd26bdd436 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:39.581096 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:39.589856 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425a287-5f88-4a98-85d1-b9a06e4e16c1 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:39.665710 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093df1e-4202-4b45-b1b3-c1164de482ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:39.666389 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093df1e-4202-4b45-b1b3-c1164de482ea None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.666709 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093df1e-4202-4b45-b1b3-c1164de482ea None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.666989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093df1e-4202-4b45-b1b3-c1164de482ea None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.667756 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093df1e-4202-4b45-b1b3-c1164de482ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:39.668067 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093df1e-4202-4b45-b1b3-c1164de482ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:39.669476 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093df1e-4202-4b45-b1b3-c1164de482ea None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:39.682362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 124/248] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:39.687822 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49260-e56a-412b-a306-1f8553097a29 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.688273 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49260-e56a-412b-a306-1f8553097a29 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.688568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49260-e56a-412b-a306-1f8553097a29 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.690737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 125/249] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:39.691910 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49260-e56a-412b-a306-1f8553097a29 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:39.726830 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:39.757982 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64452316-b62b-4c5f-aa69-60cd26bdd436 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:39.796355 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015dc0f-94a6-41d4-9296-f23bd76c16ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:39.797605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015dc0f-94a6-41d4-9296-f23bd76c16ed None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.798054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015dc0f-94a6-41d4-9296-f23bd76c16ed None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.799264 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015dc0f-94a6-41d4-9296-f23bd76c16ed None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.801372 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015dc0f-94a6-41d4-9296-f23bd76c16ed None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:39.803088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015dc0f-94a6-41d4-9296-f23bd76c16ed None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:39.805121 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 125/250] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:39 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:39.806626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789225-5e53-4782-a2ce-d1a3d6470b9c None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.807122 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789225-5e53-4782-a2ce-d1a3d6470b9c None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.807596 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1789225-5e53-4782-a2ce-d1a3d6470b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.826171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49260-e56a-412b-a306-1f8553097a29 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:39.830502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-c1789225-5e53-4782-a2ce-d1a3d6470b9c None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:39.832335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-c1789225-5e53-4782-a2ce-d1a3d6470b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:39.874525 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9651-5889-4854-bde5-07007204403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:39.875417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9651-5889-4854-bde5-07007204403b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:39.875703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9651-5889-4854-bde5-07007204403b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:39.875979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9651-5889-4854-bde5-07007204403b None admin] PATH_INFO: `/v3/users/a8590df7ef064b3ea394f517bc833db5` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:39.877750 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd9651-5889-4854-bde5-07007204403b None admin] RBAC: Authorizing `identity:get_user(user_id=a8590df7ef064b3ea394f517bc833db5)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:39.880518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd9651-5889-4854-bde5-07007204403b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:39.882377 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 126/251] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:39 2022] GET /identity/v3/users/a8590df7ef064b3ea394f517bc833db5 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:39.883031 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9651-5889-4854-bde5-07007204403b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:39.916722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:39.952137 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 126/252] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:39.953044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1789225-5e53-4782-a2ce-d1a3d6470b9c None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:40.048870 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9651-5889-4854-bde5-07007204403b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:40.063138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:40.085457 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:40.086166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.086480 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.086778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.087639 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] RBAC: Adding query filter params (role.id=da936e597e164c0e9a53de44f160bc12, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f, user.id=75c5659efa0b4c0d95065284d838f0d9) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:40.088030 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:40.088159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1789225-5e53-4782-a2ce-d1a3d6470b9c None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:40.089518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:40.102617 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 127/253] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:39 2022] GET /identity/v3/role_assignments?user.id=75c5659efa0b4c0d95065284d838f0d9&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=da936e597e164c0e9a53de44f160bc12 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:40.103648 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:40.127714 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a8ac-2e5d-4bb0-8597-cdf97dc446a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:40.128668 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a8ac-2e5d-4bb0-8597-cdf97dc446a7 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.129175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a8ac-2e5d-4bb0-8597-cdf97dc446a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.129615 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a8ac-2e5d-4bb0-8597-cdf97dc446a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.207355 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918a8ac-2e5d-4bb0-8597-cdf97dc446a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:40.209089 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918a8ac-2e5d-4bb0-8597-cdf97dc446a7 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:40.318181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:40.326819 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:40.350559 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 127/254] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:40.351806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e4b94-67ae-4d1c-a740-9d173891e44d None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:40.356757 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a8ac-2e5d-4bb0-8597-cdf97dc446a7 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:40.420707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b819b-84f3-442c-82e4-17435b96815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:40.421516 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b819b-84f3-442c-82e4-17435b96815c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.421803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b819b-84f3-442c-82e4-17435b96815c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.422079 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b819b-84f3-442c-82e4-17435b96815c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.445610 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b819b-84f3-442c-82e4-17435b96815c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-058b819b-84f3-442c-82e4-17435b96815c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:40.456115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:40.457306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:40.458089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 128/255] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:40.467364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b819b-84f3-442c-82e4-17435b96815c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:40.569340 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a8ac-2e5d-4bb0-8597-cdf97dc446a7 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:40.634109 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62c3f-b026-4105-bc9a-2c11a88448d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:40.635424 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62c3f-b026-4105-bc9a-2c11a88448d8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.635923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62c3f-b026-4105-bc9a-2c11a88448d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.636405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62c3f-b026-4105-bc9a-2c11a88448d8 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.637996 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c62c3f-b026-4105-bc9a-2c11a88448d8 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:40.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c62c3f-b026-4105-bc9a-2c11a88448d8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:40.646109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b819b-84f3-442c-82e4-17435b96815c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:40.650788 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 128/256] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:40 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:40.656794 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62c3f-b026-4105-bc9a-2c11a88448d8 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:40.684878 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:40.685612 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.685905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.686237 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.690499 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:40.690499 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:40.690499 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:40.698842 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 129/257] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:40.706500 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:40.728549 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:40.748098 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:40.828732 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796277-7d23-4fa4-8ae4-dbca06e86602 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:40.834780 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62c3f-b026-4105-bc9a-2c11a88448d8 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:40.891428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb2316-34da-4ab2-bdde-d06b360241c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:40.893352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb2316-34da-4ab2-bdde-d06b360241c7 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.893640 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb2316-34da-4ab2-bdde-d06b360241c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.893924 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb2316-34da-4ab2-bdde-d06b360241c7 None admin] PATH_INFO: `/v3/users/f1e85f2bdf784119bece81a0e8d0244e` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.895230 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca138cdf-ded9-47ae-9355-8af6e0589b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:40.895948 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca138cdf-ded9-47ae-9355-8af6e0589b47 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.896237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca138cdf-ded9-47ae-9355-8af6e0589b47 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.896517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca138cdf-ded9-47ae-9355-8af6e0589b47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.897363 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca138cdf-ded9-47ae-9355-8af6e0589b47 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f, user.id=a8590df7ef064b3ea394f517bc833db5) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:40.897676 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca138cdf-ded9-47ae-9355-8af6e0589b47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:40.899186 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca138cdf-ded9-47ae-9355-8af6e0589b47 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:40.902194 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb2316-34da-4ab2-bdde-d06b360241c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e85f2bdf784119bece81a0e8d0244e)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:40.903687 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb2316-34da-4ab2-bdde-d06b360241c7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:40.905358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 130/258] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:40 2022] GET /identity/v3/users/f1e85f2bdf784119bece81a0e8d0244e => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:40.912792 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d0dd6-7521-4695-80a7-681d18893231 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.913999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d0dd6-7521-4695-80a7-681d18893231 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.914287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d0dd6-7521-4695-80a7-681d18893231 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.916737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 131/259] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:40.916859 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 129/260] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:40 2022] GET /identity/v3/role_assignments?user.id=a8590df7ef064b3ea394f517bc833db5&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=bd8b88fae376413398183761500b2e1d => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:40.918687 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d0dd6-7521-4695-80a7-681d18893231 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:40.928963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980847f-53ff-442e-9bca-e775cef0d811 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:40.929304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980847f-53ff-442e-9bca-e775cef0d811 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:40.929531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980847f-53ff-442e-9bca-e775cef0d811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:40.955537 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-2980847f-53ff-442e-9bca-e775cef0d811 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:40.957050 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-2980847f-53ff-442e-9bca-e775cef0d811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:41.075938 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:41.093145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 130/261] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:41.127535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980847f-53ff-442e-9bca-e775cef0d811 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:41.141366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d0dd6-7521-4695-80a7-681d18893231 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:41.214430 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:41.231929 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693853e-c1b0-4057-ad43-f21bc2f48559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:41.232857 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693853e-c1b0-4057-ad43-f21bc2f48559 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:41.233147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693853e-c1b0-4057-ad43-f21bc2f48559 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:41.233467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693853e-c1b0-4057-ad43-f21bc2f48559 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:41.237851 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693853e-c1b0-4057-ad43-f21bc2f48559 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:41.239413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693853e-c1b0-4057-ad43-f21bc2f48559 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:41.241562 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 132/262] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:40 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:41.260718 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693853e-c1b0-4057-ad43-f21bc2f48559 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:41.279828 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980847f-53ff-442e-9bca-e775cef0d811 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:41.318664 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ed698-bbc5-4e56-a65d-4fc6031f4937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:41.319493 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ed698-bbc5-4e56-a65d-4fc6031f4937 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:41.319781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ed698-bbc5-4e56-a65d-4fc6031f4937 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:41.320064 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ed698-bbc5-4e56-a65d-4fc6031f4937 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:41.339534 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ed698-bbc5-4e56-a65d-4fc6031f4937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-d14ed698-bbc5-4e56-a65d-4fc6031f4937 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:41.349269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:41.350273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:41.351145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:41.351950 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 131/263] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:41.357806 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ed698-bbc5-4e56-a65d-4fc6031f4937 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:41.471837 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ed698-bbc5-4e56-a65d-4fc6031f4937 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:41.474788 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:41.509729 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:41.510409 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:41.510743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:41.511023 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:41.511778 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:41.512088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:41.513498 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:41.524306 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 132/264] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:41.529683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:41.537258 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693853e-c1b0-4057-ad43-f21bc2f48559 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:41.614101 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cab6d5-2c9c-4439-92b1-5e87c0d1a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:41.614961 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab6d5-2c9c-4439-92b1-5e87c0d1a295 None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:41.615250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab6d5-2c9c-4439-92b1-5e87c0d1a295 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:41.615529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cab6d5-2c9c-4439-92b1-5e87c0d1a295 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/users/f1e85f2bdf784119bece81a0e8d0244e/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:41.617703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cab6d5-2c9c-4439-92b1-5e87c0d1a295 None admin] RBAC: Authorizing `identity:create_grant(project_id=688bf756f62c4e97a15b6887b5f90f2f, user_id=f1e85f2bdf784119bece81a0e8d0244e, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:41.619229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cab6d5-2c9c-4439-92b1-5e87c0d1a295 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:41.689219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461876-f69b-4793-ba37-b5ef143eba3c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:41.712334 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 133/265] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:41 2022] PUT /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/users/f1e85f2bdf784119bece81a0e8d0244e/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:32:41.755477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d00e4-b254-4f66-866f-ec1db61f7f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:41.756439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d00e4-b254-4f66-866f-ec1db61f7f70 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:41.756728 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d00e4-b254-4f66-866f-ec1db61f7f70 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:41.757009 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d00e4-b254-4f66-866f-ec1db61f7f70 None admin] PATH_INFO: `/v3/users/a8590df7ef064b3ea394f517bc833db5` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:41.760512 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d00e4-b254-4f66-866f-ec1db61f7f70 None admin] RBAC: Authorizing `identity:get_user(user_id=a8590df7ef064b3ea394f517bc833db5)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:41.762103 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d00e4-b254-4f66-866f-ec1db61f7f70 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:41.764344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 133/266] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:41 2022] GET /identity/v3/users/a8590df7ef064b3ea394f517bc833db5 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:41.770695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cab6d5-2c9c-4439-92b1-5e87c0d1a295 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:41.774413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:41.913100 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cab6d5-2c9c-4439-92b1-5e87c0d1a295 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:41.959774 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660796fa-9381-4013-bd90-c17b8a961aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:41.960524 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660796fa-9381-4013-bd90-c17b8a961aba None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:41.960819 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660796fa-9381-4013-bd90-c17b8a961aba None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:41.961105 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660796fa-9381-4013-bd90-c17b8a961aba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.047093 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660796fa-9381-4013-bd90-c17b8a961aba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:42.048631 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660796fa-9381-4013-bd90-c17b8a961aba None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:42.050593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:42.153985 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 134/267] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:42.160847 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d00e4-b254-4f66-866f-ec1db61f7f70 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:42.193136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:42.321779 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d00e4-b254-4f66-866f-ec1db61f7f70 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:42.383320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5d3f1-e0ff-4908-b73b-a8da9fde5d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:42.384992 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5d3f1-e0ff-4908-b73b-a8da9fde5d39 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:42.385491 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5d3f1-e0ff-4908-b73b-a8da9fde5d39 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:42.385978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5d3f1-e0ff-4908-b73b-a8da9fde5d39 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.387425 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5d3f1-e0ff-4908-b73b-a8da9fde5d39 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:42.399231 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5d3f1-e0ff-4908-b73b-a8da9fde5d39 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:42.399231 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 134/268] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:42 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:42.399409 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660796fa-9381-4013-bd90-c17b8a961aba None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:42.510759 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8172e7-3dc4-4a33-a180-abf7a7d98493 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:42.511373 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8172e7-3dc4-4a33-a180-abf7a7d98493 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:42.511872 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8172e7-3dc4-4a33-a180-abf7a7d98493 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.513689 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 135/269] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:42.519917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b72a66-ab54-4e71-8a75-c3bd538e7fec None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:42.520485 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b72a66-ab54-4e71-8a75-c3bd538e7fec None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:42.520975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b72a66-ab54-4e71-8a75-c3bd538e7fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.552589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660796fa-9381-4013-bd90-c17b8a961aba None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:42.555111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:42.567528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-a5b72a66-ab54-4e71-8a75-c3bd538e7fec None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:42.572433 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-a5b72a66-ab54-4e71-8a75-c3bd538e7fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:42.601788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:42.602811 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:42.604324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:42.605902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.607042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] RBAC: Adding query filter params (role.id=fdcb4b876026440b87d75e4de6fdedcd, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f, user.id=a8590df7ef064b3ea394f517bc833db5) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:42.609671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:42.611442 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:42.625623 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 135/270] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:42 2022] GET /identity/v3/role_assignments?user.id=a8590df7ef064b3ea394f517bc833db5&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=fdcb4b876026440b87d75e4de6fdedcd => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:42.675188 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 136/271] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:42.715920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:42.847922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756ad22-e530-411c-9c0c-2f8f1a9185a7 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:42.858019 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361261-135f-43c4-9acf-065b23fcbf38 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:42.858320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361261-135f-43c4-9acf-065b23fcbf38 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:42.858626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361261-135f-43c4-9acf-065b23fcbf38 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.860050 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 137/272] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:42.866914 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338e43-eaaa-4772-ba6a-3931b86208b1 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:42.867208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338e43-eaaa-4772-ba6a-3931b86208b1 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:42.867492 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338e43-eaaa-4772-ba6a-3931b86208b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.890915 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c861ad7-d25e-45b6-936b-24d34c0bbffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:42.891373 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-e6338e43-eaaa-4772-ba6a-3931b86208b1 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:42.891722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c861ad7-d25e-45b6-936b-24d34c0bbffb None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:42.892155 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c861ad7-d25e-45b6-936b-24d34c0bbffb None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:42.892585 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c861ad7-d25e-45b6-936b-24d34c0bbffb None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.892696 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-e6338e43-eaaa-4772-ba6a-3931b86208b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:42.903828 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c861ad7-d25e-45b6-936b-24d34c0bbffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-6c861ad7-d25e-45b6-936b-24d34c0bbffb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:42.912066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:42.912974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:42.913760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 136/273] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:42.919699 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c861ad7-d25e-45b6-936b-24d34c0bbffb None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:42.926016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:42.962188 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:42.989654 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 138/274] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:42.991332 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487202-3468-4670-8b0f-17024cf78811 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:42.991791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487202-3468-4670-8b0f-17024cf78811 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:42.992214 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487202-3468-4670-8b0f-17024cf78811 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:42.994962 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 139/275] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:43.002651 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6d932-83c6-4c17-a759-ce2ee9192e72 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.003184 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6d932-83c6-4c17-a759-ce2ee9192e72 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.003932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6d932-83c6-4c17-a759-ce2ee9192e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.029247 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-35e6d932-83c6-4c17-a759-ce2ee9192e72 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:43.030492 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-35e6d932-83c6-4c17-a759-ce2ee9192e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:43.057962 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c861ad7-d25e-45b6-936b-24d34c0bbffb None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:43.095574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d7868-554e-4096-afee-9f51a525608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:43.096245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d7868-554e-4096-afee-9f51a525608a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.096529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d7868-554e-4096-afee-9f51a525608a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.096806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d7868-554e-4096-afee-9f51a525608a None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.097554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d7868-554e-4096-afee-9f51a525608a None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:43.097856 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d7868-554e-4096-afee-9f51a525608a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:43.099488 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d7868-554e-4096-afee-9f51a525608a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:43.110500 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 137/276] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:43.110500 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d7868-554e-4096-afee-9f51a525608a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:43.112358 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 140/277] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:43.116590 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6d932-83c6-4c17-a759-ce2ee9192e72 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:43.206533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:43.213188 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:43.218604 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d7868-554e-4096-afee-9f51a525608a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:43.226073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6d932-83c6-4c17-a759-ce2ee9192e72 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:43.256725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c86c6f-957a-47af-b470-a86b68b0854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:43.257531 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c86c6f-957a-47af-b470-a86b68b0854a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.257821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c86c6f-957a-47af-b470-a86b68b0854a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.258110 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c86c6f-957a-47af-b470-a86b68b0854a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.259351 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c86c6f-957a-47af-b470-a86b68b0854a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:43.260891 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c86c6f-957a-47af-b470-a86b68b0854a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:43.262555 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 138/278] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:43.263337 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c86c6f-957a-47af-b470-a86b68b0854a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:43.263905 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf501-983c-48ab-805a-def79a1dcaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:43.265058 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf501-983c-48ab-805a-def79a1dcaf3 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.265347 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf501-983c-48ab-805a-def79a1dcaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.265627 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf501-983c-48ab-805a-def79a1dcaf3 None admin] PATH_INFO: `/v3/users/4596f0141b3b4e7494eb86c1e5cc5e7d` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.284773 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baf501-983c-48ab-805a-def79a1dcaf3 None admin] RBAC: Authorizing `identity:get_user(user_id=4596f0141b3b4e7494eb86c1e5cc5e7d)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:43.286264 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baf501-983c-48ab-805a-def79a1dcaf3 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:43.292612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 141/279] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:43 2022] GET /identity/v3/users/4596f0141b3b4e7494eb86c1e5cc5e7d => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:43.292612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf501-983c-48ab-805a-def79a1dcaf3 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:43.379931 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c86c6f-957a-47af-b470-a86b68b0854a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:43.401409 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf501-983c-48ab-805a-def79a1dcaf3 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:43.419153 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47935bd-78ce-4451-9bf3-a8dbbcb697f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:43.419966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47935bd-78ce-4451-9bf3-a8dbbcb697f4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.420261 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47935bd-78ce-4451-9bf3-a8dbbcb697f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.420542 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47935bd-78ce-4451-9bf3-a8dbbcb697f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.434431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47935bd-78ce-4451-9bf3-a8dbbcb697f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-f47935bd-78ce-4451-9bf3-a8dbbcb697f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:43.442299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:43.443228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:43.444029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 139/280] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:43.444699 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47935bd-78ce-4451-9bf3-a8dbbcb697f4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:43.447157 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a820673-6dfb-4314-9ba9-d8c446336241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:43.447836 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820673-6dfb-4314-9ba9-d8c446336241 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.448121 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820673-6dfb-4314-9ba9-d8c446336241 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.448396 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a820673-6dfb-4314-9ba9-d8c446336241 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.449100 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a820673-6dfb-4314-9ba9-d8c446336241 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:43.450588 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a820673-6dfb-4314-9ba9-d8c446336241 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:43.469988 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:43.550755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47935bd-78ce-4451-9bf3-a8dbbcb697f4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:43.584591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:43.585301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.585669 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.585856 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.586770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] RBAC: Adding query filter params (role.id=c96e5110ca5c4ed68198a5df1ce6d04f, user.id=4596f0141b3b4e7494eb86c1e5cc5e7d, scope.system=all) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:43.587089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:43.588551 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:43.593644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 140/281] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Jul 25 09:32:43 2022] GET /identity/v3/role_assignments?user.id=4596f0141b3b4e7494eb86c1e5cc5e7d&scope.system=all&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:43.594435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:43.596215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 142/282] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:32:43 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:43.709716 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:43.732222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a875b6-74fb-47db-8723-3f7da0e973ab None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:43.775006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:43.775716 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.776006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.776289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.777073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:43.777391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:43.778940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:43.789250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 141/283] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:43.795844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a820673-6dfb-4314-9ba9-d8c446336241 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:43.799304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:43.912910 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a820673-6dfb-4314-9ba9-d8c446336241 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:43.949713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920332bc-68f2-4cbe-ad81-2d8553f92280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:43.951058 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920332bc-68f2-4cbe-ad81-2d8553f92280 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:43.951549 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920332bc-68f2-4cbe-ad81-2d8553f92280 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:43.952061 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920332bc-68f2-4cbe-ad81-2d8553f92280 None admin] PATH_INFO: `/v3/users/75c5659efa0b4c0d95065284d838f0d9` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:43.953726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920332bc-68f2-4cbe-ad81-2d8553f92280 None admin] RBAC: Authorizing `identity:get_user(user_id=75c5659efa0b4c0d95065284d838f0d9)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:43.956052 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920332bc-68f2-4cbe-ad81-2d8553f92280 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:43.958326 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 143/284] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:43 2022] GET /identity/v3/users/75c5659efa0b4c0d95065284d838f0d9 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:43.964377 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:44.080363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0e5b7-07b0-446e-a9e4-972606e8f3c4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:44.121135 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7a4ab-5db1-4268-ad5c-305e280356de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:44.122011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7a4ab-5db1-4268-ad5c-305e280356de None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:44.122298 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7a4ab-5db1-4268-ad5c-305e280356de None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:44.122613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7a4ab-5db1-4268-ad5c-305e280356de None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:44.127236 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7a4ab-5db1-4268-ad5c-305e280356de None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:44.128749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7a4ab-5db1-4268-ad5c-305e280356de None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:44.130550 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 142/285] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:43 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:44.136515 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920332bc-68f2-4cbe-ad81-2d8553f92280 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:44.230932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:44.285361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920332bc-68f2-4cbe-ad81-2d8553f92280 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:44.336577 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcb34f-d0ed-4dce-bad1-6c8d11037532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:44.337803 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcb34f-d0ed-4dce-bad1-6c8d11037532 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:44.338247 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcb34f-d0ed-4dce-bad1-6c8d11037532 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:44.338711 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcb34f-d0ed-4dce-bad1-6c8d11037532 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/users/75c5659efa0b4c0d95065284d838f0d9/roles/da936e597e164c0e9a53de44f160bc12` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:44.341132 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcb34f-d0ed-4dce-bad1-6c8d11037532 None admin] RBAC: Authorizing `identity:create_grant(project_id=688bf756f62c4e97a15b6887b5f90f2f, user_id=75c5659efa0b4c0d95065284d838f0d9, role_id=da936e597e164c0e9a53de44f160bc12)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:44.342876 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcb34f-d0ed-4dce-bad1-6c8d11037532 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:44.427542 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 144/286] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:32:44 2022] PUT /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/users/75c5659efa0b4c0d95065284d838f0d9/roles/da936e597e164c0e9a53de44f160bc12 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:44.561332 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72365e0-c093-439b-9c71-f9e33ab8cb9e None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:44.561867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72365e0-c093-439b-9c71-f9e33ab8cb9e None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:44.562389 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72365e0-c093-439b-9c71-f9e33ab8cb9e None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:44.564511 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 143/287] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:44.576852 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9f3a-16b9-4fa6-81d2-770c260d23ca None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:44.577371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9f3a-16b9-4fa6-81d2-770c260d23ca None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:44.577798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9f3a-16b9-4fa6-81d2-770c260d23ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:44.659779 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-735c9f3a-16b9-4fa6-81d2-770c260d23ca None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:44.661313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-735c9f3a-16b9-4fa6-81d2-770c260d23ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:44.752487 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 145/288] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:44.781236 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72365e0-c093-439b-9c71-f9e33ab8cb9e None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:44.796623 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:44.906830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72365e0-c093-439b-9c71-f9e33ab8cb9e None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:44.955702 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d27a-9e00-4d0c-a07e-6bd98fbc1f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:44.957014 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d27a-9e00-4d0c-a07e-6bd98fbc1f5c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:44.957445 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d27a-9e00-4d0c-a07e-6bd98fbc1f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:44.957868 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d27a-9e00-4d0c-a07e-6bd98fbc1f5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:44.969346 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677d27a-9e00-4d0c-a07e-6bd98fbc1f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-b677d27a-9e00-4d0c-a07e-6bd98fbc1f5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:44.978049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:44.979141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:44.980099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:44.986590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 144/289] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:44.988663 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9f3a-16b9-4fa6-81d2-770c260d23ca None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:45.051189 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:45.094382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9f3a-16b9-4fa6-81d2-770c260d23ca None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:45.132261 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:45.133198 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:45.133631 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:45.134064 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:45.135012 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] RBAC: Adding query filter params (name=member) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:45.135464 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:45.137127 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:45.145877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 146/290] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:45.160864 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d27a-9e00-4d0c-a07e-6bd98fbc1f5c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:45.246965 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:45.290288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d27a-9e00-4d0c-a07e-6bd98fbc1f5c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:45.343879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b02bc-f34f-48ea-b0ff-f1991af40430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:45.344772 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b02bc-f34f-48ea-b0ff-f1991af40430 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:45.345710 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b02bc-f34f-48ea-b0ff-f1991af40430 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:45.346157 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b02bc-f34f-48ea-b0ff-f1991af40430 None admin] PATH_INFO: `/v3/users/f1e85f2bdf784119bece81a0e8d0244e` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:45.347509 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b02bc-f34f-48ea-b0ff-f1991af40430 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e85f2bdf784119bece81a0e8d0244e)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:45.349001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b02bc-f34f-48ea-b0ff-f1991af40430 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:45.350788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 145/291] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:45 2022] GET /identity/v3/users/f1e85f2bdf784119bece81a0e8d0244e => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:45.356602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:45.483449 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6fcc6-4573-415c-9f2a-2b5265e177ff None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:45.516125 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:45.530177 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e748a20-e033-4709-aa92-fdaf1b756236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:45.530861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e748a20-e033-4709-aa92-fdaf1b756236 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:45.531152 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e748a20-e033-4709-aa92-fdaf1b756236 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:45.533494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e748a20-e033-4709-aa92-fdaf1b756236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:45.619692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e748a20-e033-4709-aa92-fdaf1b756236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:45.621161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e748a20-e033-4709-aa92-fdaf1b756236 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:45.750716 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 147/292] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:45.756616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b02bc-f34f-48ea-b0ff-f1991af40430 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:45.903044 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b02bc-f34f-48ea-b0ff-f1991af40430 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:45.948583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c57d7f-ae10-4bbd-8d4a-14bf69b2a3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:45.949453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c57d7f-ae10-4bbd-8d4a-14bf69b2a3e3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:45.949740 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c57d7f-ae10-4bbd-8d4a-14bf69b2a3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:45.950020 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c57d7f-ae10-4bbd-8d4a-14bf69b2a3e3 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:45.951288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c57d7f-ae10-4bbd-8d4a-14bf69b2a3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:45.952750 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c57d7f-ae10-4bbd-8d4a-14bf69b2a3e3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:45.955495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 146/293] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:45 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:45.961303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e748a20-e033-4709-aa92-fdaf1b756236 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:46.009051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:46.126847 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e748a20-e033-4709-aa92-fdaf1b756236 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:46.177151 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ea340-8cc0-47ac-a670-f681ad759052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:46.178206 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea340-8cc0-47ac-a670-f681ad759052 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:46.178733 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea340-8cc0-47ac-a670-f681ad759052 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:46.179266 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea340-8cc0-47ac-a670-f681ad759052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:46.180326 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ea340-8cc0-47ac-a670-f681ad759052 None admin] RBAC: Adding query filter params (role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f, user.id=f1e85f2bdf784119bece81a0e8d0244e) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:46.180844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ea340-8cc0-47ac-a670-f681ad759052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:46.182536 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ea340-8cc0-47ac-a670-f681ad759052 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:46.195130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 148/294] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:45 2022] GET /identity/v3/role_assignments?user.id=f1e85f2bdf784119bece81a0e8d0244e&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:46.225029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241253-9023-4162-8760-5fc80e553710 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:46.225384 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241253-9023-4162-8760-5fc80e553710 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:46.225606 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1241253-9023-4162-8760-5fc80e553710 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:46.227177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 147/295] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:46.239033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8ee64-b7fe-4f1d-8c62-5771d9c7b285 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:46.239370 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8ee64-b7fe-4f1d-8c62-5771d9c7b285 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:46.239606 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8ee64-b7fe-4f1d-8c62-5771d9c7b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:46.268449 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-ddd8ee64-b7fe-4f1d-8c62-5771d9c7b285 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:46.269685 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-ddd8ee64-b7fe-4f1d-8c62-5771d9c7b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:46.377186 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 149/296] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:46.415934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1241253-9023-4162-8760-5fc80e553710 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:46.429861 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:46.556894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1241253-9023-4162-8760-5fc80e553710 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:46.578995 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95d9ad-7200-4d31-95db-947860521345 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:46.580134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95d9ad-7200-4d31-95db-947860521345 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:46.580134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95d9ad-7200-4d31-95db-947860521345 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:46.585710 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 150/297] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:46.588278 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c870-5867-4ef0-874c-2e48710fb3f2 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:46.588809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c870-5867-4ef0-874c-2e48710fb3f2 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:46.589108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82c870-5867-4ef0-874c-2e48710fb3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:46.602379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247f8c8-f8a0-4932-a01e-eca3615f0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:46.603215 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247f8c8-f8a0-4932-a01e-eca3615f0e0a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:46.603500 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247f8c8-f8a0-4932-a01e-eca3615f0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:46.603776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247f8c8-f8a0-4932-a01e-eca3615f0e0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:46.616623 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247f8c8-f8a0-4932-a01e-eca3615f0e0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-3247f8c8-f8a0-4932-a01e-eca3615f0e0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:46.624544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:46.625450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:46.626359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 148/298] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:46.631488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-8c82c870-5867-4ef0-874c-2e48710fb3f2 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:46.632701 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-8c82c870-5867-4ef0-874c-2e48710fb3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:46.633544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247f8c8-f8a0-4932-a01e-eca3615f0e0a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:46.650344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:46.706881 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:46.751029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247f8c8-f8a0-4932-a01e-eca3615f0e0a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:46.757980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 151/299] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:46.788291 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82c870-5867-4ef0-874c-2e48710fb3f2 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:46.799456 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:46.800867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:46.801653 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:46.802148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:46.803433 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:46.804418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:46.806719 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:46.820009 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 149/300] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:46.832432 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:46.898834 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82c870-5867-4ef0-874c-2e48710fb3f2 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:46.939727 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68505d-a2b0-455b-bca0-797ad838d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:46.940831 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68505d-a2b0-455b-bca0-797ad838d760 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:46.941116 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68505d-a2b0-455b-bca0-797ad838d760 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:46.941393 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68505d-a2b0-455b-bca0-797ad838d760 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:46.942620 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68505d-a2b0-455b-bca0-797ad838d760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:46.944280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68505d-a2b0-455b-bca0-797ad838d760 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:46.946072 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 152/301] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:46.951621 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68505d-a2b0-455b-bca0-797ad838d760 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:46.966477 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1916bb-0d4c-4c6d-ac74-cb78059ac710 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:46.969017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:46.996412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:47.004735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c81b-2611-4e9c-a6e0-ad9e2b9fb5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:47.005622 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c81b-2611-4e9c-a6e0-ad9e2b9fb5c7 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.005908 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c81b-2611-4e9c-a6e0-ad9e2b9fb5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.006192 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c81b-2611-4e9c-a6e0-ad9e2b9fb5c7 None admin] PATH_INFO: `/v3/users/4596f0141b3b4e7494eb86c1e5cc5e7d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.007455 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c81b-2611-4e9c-a6e0-ad9e2b9fb5c7 None admin] RBAC: Authorizing `identity:get_user(user_id=4596f0141b3b4e7494eb86c1e5cc5e7d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:47.010072 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c81b-2611-4e9c-a6e0-ad9e2b9fb5c7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:47.016889 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 150/302] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:46 2022] GET /identity/v3/users/4596f0141b3b4e7494eb86c1e5cc5e7d => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:47.018275 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c81b-2611-4e9c-a6e0-ad9e2b9fb5c7 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:47.067112 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68505d-a2b0-455b-bca0-797ad838d760 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:47.104751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a9bc7-d78c-4975-93dd-5349dcfd55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:47.105345 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9bc7-d78c-4975-93dd-5349dcfd55aa None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.105625 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9bc7-d78c-4975-93dd-5349dcfd55aa None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.105899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a9bc7-d78c-4975-93dd-5349dcfd55aa None admin] PATH_INFO: `/v3/groups` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.106706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a9bc7-d78c-4975-93dd-5349dcfd55aa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:47.108154 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a9bc7-d78c-4975-93dd-5349dcfd55aa None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:47.130331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c81b-2611-4e9c-a6e0-ad9e2b9fb5c7 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:47.165449 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b99e1-80c4-4f3f-bbf5-20f767e04375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:47.166313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b99e1-80c4-4f3f-bbf5-20f767e04375 None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.166643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b99e1-80c4-4f3f-bbf5-20f767e04375 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.166929 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b99e1-80c4-4f3f-bbf5-20f767e04375 None admin] PATH_INFO: `/v3/system/users/4596f0141b3b4e7494eb86c1e5cc5e7d/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.168764 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b99e1-80c4-4f3f-bbf5-20f767e04375 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4596f0141b3b4e7494eb86c1e5cc5e7d, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:47.170164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b99e1-80c4-4f3f-bbf5-20f767e04375 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:47.208325 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 153/303] 10.222.0.67 () {60 vars in 1134 bytes} [Mon Jul 25 09:32:46 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:32:47.208325 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85fb4f-7794-4336-89e0-7ff4cd4164cc None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.208325 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85fb4f-7794-4336-89e0-7ff4cd4164cc None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.208325 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85fb4f-7794-4336-89e0-7ff4cd4164cc None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.208325 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 154/304] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:47.216395 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79078-6071-4424-b64c-dab1aad4c1de None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.216783 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79078-6071-4424-b64c-dab1aad4c1de None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.216981 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79078-6071-4424-b64c-dab1aad4c1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.239243 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-ace79078-6071-4424-b64c-dab1aad4c1de None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:47.240737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-ace79078-6071-4424-b64c-dab1aad4c1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:47.295882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 151/305] 10.222.0.67 () {58 vars in 1334 bytes} [Mon Jul 25 09:32:47 2022] PUT /identity/v3/system/users/4596f0141b3b4e7494eb86c1e5cc5e7d/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:32:47.341850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 155/306] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:47.369314 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b99e1-80c4-4f3f-bbf5-20f767e04375 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:47.397179 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dda67-c936-4f0e-8f12-2a0731d90cb6 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.397500 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dda67-c936-4f0e-8f12-2a0731d90cb6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.397747 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dda67-c936-4f0e-8f12-2a0731d90cb6 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.399703 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 156/307] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:32:47.408489 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbc9b-8e31-45d8-a894-653c64078b45 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.408980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbc9b-8e31-45d8-a894-653c64078b45 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.409147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbc9b-8e31-45d8-a894-653c64078b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.418125 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:47.431782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-7cdcbc9b-8e31-45d8-a894-653c64078b45 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:47.433131 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-7cdcbc9b-8e31-45d8-a894-653c64078b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:47.450760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:47.512704 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b99e1-80c4-4f3f-bbf5-20f767e04375 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:47.523379 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 157/308] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:47.550106 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcbc9b-8e31-45d8-a894-653c64078b45 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:47.553932 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687424c1-4278-41eb-a79c-6f628bf69810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:47.555745 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687424c1-4278-41eb-a79c-6f628bf69810 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.556046 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687424c1-4278-41eb-a79c-6f628bf69810 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.556345 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687424c1-4278-41eb-a79c-6f628bf69810 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.568934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687424c1-4278-41eb-a79c-6f628bf69810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-687424c1-4278-41eb-a79c-6f628bf69810 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:47.579226 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:47.582073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:47.582894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 152/309] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:47.587451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687424c1-4278-41eb-a79c-6f628bf69810 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:47.679138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcbc9b-8e31-45d8-a894-653c64078b45 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:47.726089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687424c1-4278-41eb-a79c-6f628bf69810 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:47.726798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3e56e-9b49-4f4f-9b4b-e63385412426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:47.727680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e56e-9b49-4f4f-9b4b-e63385412426 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.728039 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e56e-9b49-4f4f-9b4b-e63385412426 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.728390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e56e-9b49-4f4f-9b4b-e63385412426 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.731661 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:47.747178 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3e56e-9b49-4f4f-9b4b-e63385412426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:47.750351 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-b3d3e56e-9b49-4f4f-9b4b-e63385412426 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:47.759114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:47.760017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:47.760811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 158/310] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:47.766516 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3e56e-9b49-4f4f-9b4b-e63385412426 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:47.773164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:47.774294 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.774624 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.774913 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.775683 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:47.775999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:47.777563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:47.790458 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 153/311] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:47.796074 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:47.896087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3e56e-9b49-4f4f-9b4b-e63385412426 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:47.902755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacc051-2883-4050-a3d7-30ead3434e6b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:47.940812 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157872c4-59b5-4608-874b-038131aa6b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:47.941643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157872c4-59b5-4608-874b-038131aa6b43 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.941932 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157872c4-59b5-4608-874b-038131aa6b43 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.942215 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157872c4-59b5-4608-874b-038131aa6b43 None admin] PATH_INFO: `/v3/users/7e5e04cf1762496fa8ff9ce4a0cab63b` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.942672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:47.943581 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:47.944332 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:47.944844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:47.946698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:47.947216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:47.948767 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:47.957493 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157872c4-59b5-4608-874b-038131aa6b43 None admin] RBAC: Authorizing `identity:get_user(user_id=7e5e04cf1762496fa8ff9ce4a0cab63b)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:47.959162 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157872c4-59b5-4608-874b-038131aa6b43 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:47.964787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 154/312] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:47 2022] GET /identity/v3/users/7e5e04cf1762496fa8ff9ce4a0cab63b => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:47.965522 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 159/313] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:47.966604 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157872c4-59b5-4608-874b-038131aa6b43 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:47.967196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:48.012632 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:48.031643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:48.075779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157872c4-59b5-4608-874b-038131aa6b43 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:48.081065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bde14e-1454-45ad-a6d9-c19978e0aa19 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:48.113139 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd994238-377c-4c0a-8a30-8bc23a47676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:48.114183 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd994238-377c-4c0a-8a30-8bc23a47676d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:48.114607 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd994238-377c-4c0a-8a30-8bc23a47676d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:48.114991 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd994238-377c-4c0a-8a30-8bc23a47676d None admin] PATH_INFO: `/v3/users/75c5659efa0b4c0d95065284d838f0d9` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:48.116346 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd994238-377c-4c0a-8a30-8bc23a47676d None admin] RBAC: Authorizing `identity:get_user(user_id=75c5659efa0b4c0d95065284d838f0d9)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:48.118101 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd994238-377c-4c0a-8a30-8bc23a47676d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:48.120486 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 155/314] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:47 2022] GET /identity/v3/users/75c5659efa0b4c0d95065284d838f0d9 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:48.121093 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:48.121939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:48.122379 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:48.122813 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:48.123769 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] RBAC: Adding query filter params (role.id=da936e597e164c0e9a53de44f160bc12, user.id=7e5e04cf1762496fa8ff9ce4a0cab63b, scope.system=all) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:48.124211 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:48.125830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd994238-377c-4c0a-8a30-8bc23a47676d None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:48.126068 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:48.132953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 160/315] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Jul 25 09:32:47 2022] GET /identity/v3/role_assignments?user.id=7e5e04cf1762496fa8ff9ce4a0cab63b&scope.system=all&role.id=da936e597e164c0e9a53de44f160bc12 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:48.242276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd994238-377c-4c0a-8a30-8bc23a47676d None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:48.253909 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:48.281148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e23afc-a612-40ad-adfd-029b1893d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:48.282150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23afc-a612-40ad-adfd-029b1893d40c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:48.282827 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23afc-a612-40ad-adfd-029b1893d40c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:48.283274 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e23afc-a612-40ad-adfd-029b1893d40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:48.363490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e23afc-a612-40ad-adfd-029b1893d40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:48.364964 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e23afc-a612-40ad-adfd-029b1893d40c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:48.597600 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 156/316] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:48.603377 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:48.716479 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc3eca-b4a2-4ec1-9349-c05f427a5fa2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:48.738175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:48.755288 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3324a7-f950-4110-84ab-be93e3caf385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:48.756464 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3324a7-f950-4110-84ab-be93e3caf385 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:48.756952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3324a7-f950-4110-84ab-be93e3caf385 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:48.757447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3324a7-f950-4110-84ab-be93e3caf385 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:48.758861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3324a7-f950-4110-84ab-be93e3caf385 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:48.760626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3324a7-f950-4110-84ab-be93e3caf385 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:48.762880 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 161/317] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:48 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:48.768994 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e23afc-a612-40ad-adfd-029b1893d40c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:48.779589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:48.873214 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e23afc-a612-40ad-adfd-029b1893d40c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:48.910537 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a55c7-2d40-4a42-9dff-073da51f3f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:48.911209 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a55c7-2d40-4a42-9dff-073da51f3f10 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:48.911498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a55c7-2d40-4a42-9dff-073da51f3f10 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:48.911780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a55c7-2d40-4a42-9dff-073da51f3f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:48.912616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a55c7-2d40-4a42-9dff-073da51f3f10 None admin] RBAC: Adding query filter params (role.id=da936e597e164c0e9a53de44f160bc12, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f, user.id=75c5659efa0b4c0d95065284d838f0d9) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:48.912992 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a55c7-2d40-4a42-9dff-073da51f3f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:48.914486 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a55c7-2d40-4a42-9dff-073da51f3f10 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:48.920807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 157/318] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:32:48 2022] GET /identity/v3/role_assignments?user.id=75c5659efa0b4c0d95065284d838f0d9&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=da936e597e164c0e9a53de44f160bc12 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:49.618883 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7a26-bc13-49f6-8851-54132b2969c9 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:49.619092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7a26-bc13-49f6-8851-54132b2969c9 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:49.619537 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7a26-bc13-49f6-8851-54132b2969c9 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:49.621051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 162/319] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:49.626038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8d77-b3a1-456c-adba-1f47a7a672da None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:49.626552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8d77-b3a1-456c-adba-1f47a7a672da None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:49.626752 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8d77-b3a1-456c-adba-1f47a7a672da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:49.645542 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-0aba8d77-b3a1-456c-adba-1f47a7a672da None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:49.646753 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-0aba8d77-b3a1-456c-adba-1f47a7a672da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:49.651977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42debe-8747-4dae-b78a-a759720dfd19 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:49.652278 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42debe-8747-4dae-b78a-a759720dfd19 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:49.652564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42debe-8747-4dae-b78a-a759720dfd19 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:49.654092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 163/320] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:32:49.660273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc42d-91de-48f9-8322-031189117862 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:49.660631 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc42d-91de-48f9-8322-031189117862 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:49.660926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc42d-91de-48f9-8322-031189117862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:49.680423 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-450cc42d-91de-48f9-8322-031189117862 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:49.681803 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-450cc42d-91de-48f9-8322-031189117862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:49.726038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 158/321] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:49.750284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba8d77-b3a1-456c-adba-1f47a7a672da None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:49.752754 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:49.758514 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 164/322] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:49.781191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cc42d-91de-48f9-8322-031189117862 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:49.859163 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba8d77-b3a1-456c-adba-1f47a7a672da None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:49.888865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cc42d-91de-48f9-8322-031189117862 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:49.894914 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decd73-f014-44b8-91cf-615d529f3dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:49.895715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decd73-f014-44b8-91cf-615d529f3dee None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:49.895996 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decd73-f014-44b8-91cf-615d529f3dee None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:49.896399 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decd73-f014-44b8-91cf-615d529f3dee None admin] PATH_INFO: `/v3/domains/default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:49.897655 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decd73-f014-44b8-91cf-615d529f3dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:49.899446 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decd73-f014-44b8-91cf-615d529f3dee None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:49.905836 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 159/323] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:49.906643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:49.906830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decd73-f014-44b8-91cf-615d529f3dee None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:49.925324 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d4be-7415-4933-91d4-98f25c709cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:49.926126 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d4be-7415-4933-91d4-98f25c709cb9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:49.926415 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d4be-7415-4933-91d4-98f25c709cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:49.926728 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45d4be-7415-4933-91d4-98f25c709cb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:49.937751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45d4be-7415-4933-91d4-98f25c709cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-ea45d4be-7415-4933-91d4-98f25c709cb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:49.946246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:49.947308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:49.948090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 165/324] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:32:49.953167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d4be-7415-4933-91d4-98f25c709cb9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:49.984896 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:50.020016 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decd73-f014-44b8-91cf-615d529f3dee None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:50.058662 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ea480-2b4c-4115-96fb-e0ddc27e6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:50.059343 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ea480-2b4c-4115-96fb-e0ddc27e6bf9 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:50.059629 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ea480-2b4c-4115-96fb-e0ddc27e6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:50.059903 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ea480-2b4c-4115-96fb-e0ddc27e6bf9 None admin] PATH_INFO: `/v3/groups` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:50.060602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ea480-2b4c-4115-96fb-e0ddc27e6bf9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:50.062041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ea480-2b4c-4115-96fb-e0ddc27e6bf9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:50.069864 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45d4be-7415-4933-91d4-98f25c709cb9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:50.104182 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:50.104892 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:50.105232 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:50.105518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:50.106261 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] RBAC: Adding query filter params (name=member) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:50.106605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:50.107986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:50.116347 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 166/325] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:50.121684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:50.164713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:50.180706 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 160/326] 10.222.0.67 () {60 vars in 1134 bytes} [Mon Jul 25 09:32:49 2022] POST /identity/v3/groups => generated 226 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:32:50.229016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ba5d9-c1ac-4e6d-97e5-747153e58c86 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:50.270371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1cf30-d678-4bb0-8980-926841c744ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:50.271831 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cf30-d678-4bb0-8980-926841c744ad None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:50.272341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cf30-d678-4bb0-8980-926841c744ad None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:50.272827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cf30-d678-4bb0-8980-926841c744ad None admin] PATH_INFO: `/v3/users/4596f0141b3b4e7494eb86c1e5cc5e7d` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:50.274699 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1cf30-d678-4bb0-8980-926841c744ad None admin] RBAC: Authorizing `identity:get_user(user_id=4596f0141b3b4e7494eb86c1e5cc5e7d)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:50.276515 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1cf30-d678-4bb0-8980-926841c744ad None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:50.279005 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 167/327] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:50 2022] GET /identity/v3/users/4596f0141b3b4e7494eb86c1e5cc5e7d => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:50.285621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ea480-2b4c-4115-96fb-e0ddc27e6bf9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:50.405115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ea480-2b4c-4115-96fb-e0ddc27e6bf9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:50.420217 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927d03-499a-4390-b4d5-d6f0ff472844 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:50.420471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927d03-499a-4390-b4d5-d6f0ff472844 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:50.420889 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927d03-499a-4390-b4d5-d6f0ff472844 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:50.422389 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 168/328] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:50.428056 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c35000-c844-45d0-a552-60d239e29ca2 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:50.428346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c35000-c844-45d0-a552-60d239e29ca2 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:50.428629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c35000-c844-45d0-a552-60d239e29ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:50.436282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:50.443607 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:50.444755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:50.445047 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:50.445331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:50.446511 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] RBAC: Adding query filter params (role.id=c96e5110ca5c4ed68198a5df1ce6d04f, user.id=4596f0141b3b4e7494eb86c1e5cc5e7d, scope.system=all) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:50.446863 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:50.448355 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:50.450364 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-22c35000-c844-45d0-a552-60d239e29ca2 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:50.450902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-22c35000-c844-45d0-a552-60d239e29ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:50.464405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 161/329] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Jul 25 09:32:50 2022] GET /identity/v3/role_assignments?user.id=4596f0141b3b4e7494eb86c1e5cc5e7d&scope.system=all&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:50.540395 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 169/330] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:50.566452 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:50.687686 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9b1c-fc61-4fb9-ab23-aff435d90768 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:50.727785 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd81c6-4fd0-4225-89f2-5b6913ca93d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:50.728596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd81c6-4fd0-4225-89f2-5b6913ca93d7 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:50.728886 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd81c6-4fd0-4225-89f2-5b6913ca93d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:50.729166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd81c6-4fd0-4225-89f2-5b6913ca93d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:50.740550 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd81c6-4fd0-4225-89f2-5b6913ca93d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-48fd81c6-4fd0-4225-89f2-5b6913ca93d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:50.748325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:50.749193 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:50.750002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:50.753142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 162/331] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:50.756428 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c35000-c844-45d0-a552-60d239e29ca2 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:50.800771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:50.868547 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c35000-c844-45d0-a552-60d239e29ca2 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:50.911683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:50.912374 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:50.912660 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:50.912939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:50.913697 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:50.914004 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:50.915487 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:50.928790 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 170/332] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:50.934343 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd81c6-4fd0-4225-89f2-5b6913ca93d7 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:50.990282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:51.048942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd81c6-4fd0-4225-89f2-5b6913ca93d7 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:51.086831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b8f4c-a29e-4ebe-9459-62a9d59455f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:51.087720 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8f4c-a29e-4ebe-9459-62a9d59455f4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:51.088008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8f4c-a29e-4ebe-9459-62a9d59455f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:51.088288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b8f4c-a29e-4ebe-9459-62a9d59455f4 None admin] PATH_INFO: `/v3/users/7e5e04cf1762496fa8ff9ce4a0cab63b` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:51.089512 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8f4c-a29e-4ebe-9459-62a9d59455f4 None admin] RBAC: Authorizing `identity:get_user(user_id=7e5e04cf1762496fa8ff9ce4a0cab63b)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:51.091021 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b8f4c-a29e-4ebe-9459-62a9d59455f4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:51.097401 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 163/333] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:50 2022] GET /identity/v3/users/7e5e04cf1762496fa8ff9ce4a0cab63b => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:51.098771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:51.213039 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:51.216724 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6dce1-3530-4ead-8d5b-fc1724b789a9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:51.261604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88f0c9-a52d-40f7-a368-72d935fbdfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:51.262405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f0c9-a52d-40f7-a368-72d935fbdfe2 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:51.262725 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f0c9-a52d-40f7-a368-72d935fbdfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:51.263006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88f0c9-a52d-40f7-a368-72d935fbdfe2 None admin] PATH_INFO: `/v3/system/users/7e5e04cf1762496fa8ff9ce4a0cab63b/roles/da936e597e164c0e9a53de44f160bc12` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:51.264527 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88f0c9-a52d-40f7-a368-72d935fbdfe2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7e5e04cf1762496fa8ff9ce4a0cab63b, role_id=da936e597e164c0e9a53de44f160bc12)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:51.265917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88f0c9-a52d-40f7-a368-72d935fbdfe2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:51.358256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 171/334] 10.222.0.67 () {58 vars in 1334 bytes} [Mon Jul 25 09:32:51 2022] PUT /identity/v3/system/users/7e5e04cf1762496fa8ff9ce4a0cab63b/roles/da936e597e164c0e9a53de44f160bc12 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:32:53.267184 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacdbc-5063-42cb-ab65-1890d7ca2b2e None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:53.267694 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacdbc-5063-42cb-ab65-1890d7ca2b2e None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:53.267767 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaacdbc-5063-42cb-ab65-1890d7ca2b2e None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:53.269449 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 164/335] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:53.285977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857885-2248-420d-8590-f2666dd9134d None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:53.286486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857885-2248-420d-8590-f2666dd9134d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:53.286594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05857885-2248-420d-8590-f2666dd9134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:53.311731 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-05857885-2248-420d-8590-f2666dd9134d None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:53.312929 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-05857885-2248-420d-8590-f2666dd9134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:53.411941 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 172/336] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:53.460615 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaacdbc-5063-42cb-ab65-1890d7ca2b2e None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:53.461496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac66b4-f499-4d8c-95d0-43d2a4d446f8 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:53.461760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac66b4-f499-4d8c-95d0-43d2a4d446f8 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:53.462046 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac66b4-f499-4d8c-95d0-43d2a4d446f8 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:53.463751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 173/337] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:53.469473 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba36245-05d1-4471-8d70-2cc2a4d02505 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:53.470431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba36245-05d1-4471-8d70-2cc2a4d02505 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:53.470672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba36245-05d1-4471-8d70-2cc2a4d02505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:53.505143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-fba36245-05d1-4471-8d70-2cc2a4d02505 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:53.506368 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-fba36245-05d1-4471-8d70-2cc2a4d02505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:53.651047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 174/338] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:53.674171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaacdbc-5063-42cb-ab65-1890d7ca2b2e None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:53.693594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba36245-05d1-4471-8d70-2cc2a4d02505 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:53.716302 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:53.738897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:53.761061 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48816de-efa6-4345-b2f7-924cd50749e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:53.761888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48816de-efa6-4345-b2f7-924cd50749e5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:53.762173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48816de-efa6-4345-b2f7-924cd50749e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:53.762450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48816de-efa6-4345-b2f7-924cd50749e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:53.781185 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48816de-efa6-4345-b2f7-924cd50749e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-c48816de-efa6-4345-b2f7-924cd50749e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:53.798940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:53.799956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:53.800930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 165/339] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:53.806537 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfabda-d78b-4cf6-98de-7dc401b620ad None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:53.806827 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfabda-d78b-4cf6-98de-7dc401b620ad None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:53.807116 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfabda-d78b-4cf6-98de-7dc401b620ad None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:53.808606 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 166/340] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:53.809160 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfabda-d78b-4cf6-98de-7dc401b620ad None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:53.880971 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba36245-05d1-4471-8d70-2cc2a4d02505 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:53.946883 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c67d36-1012-459e-977e-b78dfbf09143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:53.948666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c67d36-1012-459e-977e-b78dfbf09143 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:53.948954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c67d36-1012-459e-977e-b78dfbf09143 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:53.949233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c67d36-1012-459e-977e-b78dfbf09143 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:53.972345 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c67d36-1012-459e-977e-b78dfbf09143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-96c67d36-1012-459e-977e-b78dfbf09143 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:53.980164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:53.981051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:53.982298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 175/341] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:32:53.983166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10340-8e96-47fe-a10b-0b825e80f6a5 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:53.983422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10340-8e96-47fe-a10b-0b825e80f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:53.993991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd10340-8e96-47fe-a10b-0b825e80f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.025066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfabda-d78b-4cf6-98de-7dc401b620ad None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:54.036716 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-3cd10340-8e96-47fe-a10b-0b825e80f6a5 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:54.037936 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-3cd10340-8e96-47fe-a10b-0b825e80f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:54.092244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:54.092935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:54.093221 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:54.093502 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.094262 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:54.094600 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:54.096166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:54.116428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 167/342] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:54.117079 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:54.168104 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 176/343] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:54.168968 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10340-8e96-47fe-a10b-0b825e80f6a5 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:54.208925 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:54.214840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:54.320073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934bbf5-cb3f-4a63-a403-0a13c8ea6d8f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:54.378650 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd10340-8e96-47fe-a10b-0b825e80f6a5 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:54.385540 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:54.386663 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:54.387157 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:54.387673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.388644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:54.389155 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:54.391084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:54.414849 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 168/344] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:54.415717 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:54.429276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b5b0f-611c-4bdd-a004-7a82938127f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:54.429992 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5b0f-611c-4bdd-a004-7a82938127f0 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:54.430282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5b0f-611c-4bdd-a004-7a82938127f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:54.430585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5b0f-611c-4bdd-a004-7a82938127f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.566319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5b0f-611c-4bdd-a004-7a82938127f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:54.567840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5b0f-611c-4bdd-a004-7a82938127f0 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:54.596567 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:54.611474 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa9ee2-f9cf-4932-8493-87c3f5f880c1 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:54.624672 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:54.678086 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c79f2-23a1-466e-8ccf-feb5d21632b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:54.678941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c79f2-23a1-466e-8ccf-feb5d21632b4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:54.679228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c79f2-23a1-466e-8ccf-feb5d21632b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:54.682175 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c79f2-23a1-466e-8ccf-feb5d21632b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.703876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c79f2-23a1-466e-8ccf-feb5d21632b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-8b4c79f2-23a1-466e-8ccf-feb5d21632b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:54.713005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:54.713912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:54.714770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 169/345] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:54.715912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c79f2-23a1-466e-8ccf-feb5d21632b4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:54.728734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 177/346] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:54.730068 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4eca-6696-4ddc-9ce6-cb247c07d9bd None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:54.730356 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4eca-6696-4ddc-9ce6-cb247c07d9bd None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:54.730670 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4eca-6696-4ddc-9ce6-cb247c07d9bd None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.732068 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 178/347] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:54.732616 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca4eca-6696-4ddc-9ce6-cb247c07d9bd None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:54.854601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c79f2-23a1-466e-8ccf-feb5d21632b4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:54.865098 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca4eca-6696-4ddc-9ce6-cb247c07d9bd None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:54.883975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:54.906271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422f508-c145-4cd1-ae07-c00bc80f790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:54.906993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f508-c145-4cd1-ae07-c00bc80f790f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:54.907333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f508-c145-4cd1-ae07-c00bc80f790f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:54.907593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f508-c145-4cd1-ae07-c00bc80f790f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.912612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c51cf0-8621-4f3b-9f6d-e86a5a9fd06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:54.913307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51cf0-8621-4f3b-9f6d-e86a5a9fd06d None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:54.913651 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51cf0-8621-4f3b-9f6d-e86a5a9fd06d None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:54.913936 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c51cf0-8621-4f3b-9f6d-e86a5a9fd06d None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.914791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c51cf0-8621-4f3b-9f6d-e86a5a9fd06d None admin] RBAC: Adding query filter params (name=member) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:54.915102 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c51cf0-8621-4f3b-9f6d-e86a5a9fd06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:54.916602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c51cf0-8621-4f3b-9f6d-e86a5a9fd06d None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:54.930717 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 179/348] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:54.931889 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50ecb0-c5ee-40d0-8ff5-1792ff906316 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:54.932180 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50ecb0-c5ee-40d0-8ff5-1792ff906316 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:54.932462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50ecb0-c5ee-40d0-8ff5-1792ff906316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:54.945264 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:54.951871 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-ad50ecb0-c5ee-40d0-8ff5-1792ff906316 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:54.953060 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-ad50ecb0-c5ee-40d0-8ff5-1792ff906316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:54.997712 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422f508-c145-4cd1-ae07-c00bc80f790f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:54.999324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422f508-c145-4cd1-ae07-c00bc80f790f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:55.041175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 180/349] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:55.042274 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50ecb0-c5ee-40d0-8ff5-1792ff906316 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:55.144372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 170/350] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:55.147240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be757-f8dd-4ad2-8c7d-ce2a9ea874af None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.147749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be757-f8dd-4ad2-8c7d-ce2a9ea874af None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.148038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be757-f8dd-4ad2-8c7d-ce2a9ea874af None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.149735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 171/351] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:55.150315 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be757-f8dd-4ad2-8c7d-ce2a9ea874af None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:55.232347 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:55.286965 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50ecb0-c5ee-40d0-8ff5-1792ff906316 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:55.289995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be757-f8dd-4ad2-8c7d-ce2a9ea874af None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:55.295862 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:55.331981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59180e5-0419-4a74-9ef4-e2d8e64ca77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:55.332651 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59180e5-0419-4a74-9ef4-e2d8e64ca77b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.332941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59180e5-0419-4a74-9ef4-e2d8e64ca77b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.333210 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59180e5-0419-4a74-9ef4-e2d8e64ca77b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.335028 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fad6e2-ae68-459c-a930-9c09efe4fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:55.335900 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fad6e2-ae68-459c-a930-9c09efe4fa73 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.336186 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fad6e2-ae68-459c-a930-9c09efe4fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.336459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fad6e2-ae68-459c-a930-9c09efe4fa73 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.338768 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fad6e2-ae68-459c-a930-9c09efe4fa73 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:55.340311 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fad6e2-ae68-459c-a930-9c09efe4fa73 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:55.342418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 181/352] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:55 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:55.343766 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fad6e2-ae68-459c-a930-9c09efe4fa73 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:55.412692 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59180e5-0419-4a74-9ef4-e2d8e64ca77b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:55.414130 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59180e5-0419-4a74-9ef4-e2d8e64ca77b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:55.468253 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fad6e2-ae68-459c-a930-9c09efe4fa73 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:55.484995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:55.517097 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b210a-3fca-4a94-8d69-b52764c6944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:55.517674 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b210a-3fca-4a94-8d69-b52764c6944c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.518591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b210a-3fca-4a94-8d69-b52764c6944c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.518591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b210a-3fca-4a94-8d69-b52764c6944c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.530219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b210a-3fca-4a94-8d69-b52764c6944c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:55.538965 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 172/353] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-625b210a-3fca-4a94-8d69-b52764c6944c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:55.539917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:55.540802 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:55.541601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 182/354] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:55.542234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b210a-3fca-4a94-8d69-b52764c6944c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:55.543276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd6d3a-c76a-4952-93e3-b22e716db17c None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.543708 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd6d3a-c76a-4952-93e3-b22e716db17c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.544125 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd6d3a-c76a-4952-93e3-b22e716db17c None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.550684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 173/355] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:55.550684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b729-73d2-4db8-84c7-0e3f1e9db435 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.550684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b729-73d2-4db8-84c7-0e3f1e9db435 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.550684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b729-73d2-4db8-84c7-0e3f1e9db435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.570407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-51d6b729-73d2-4db8-84c7-0e3f1e9db435 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:55.571646 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-51d6b729-73d2-4db8-84c7-0e3f1e9db435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:55.587900 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:55.656735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 174/356] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:55.657646 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6b729-73d2-4db8-84c7-0e3f1e9db435 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:55.667750 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b210a-3fca-4a94-8d69-b52764c6944c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:55.711253 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf0e7-db99-4edc-976a-0cc059870afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:55.712137 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf0e7-db99-4edc-976a-0cc059870afc None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.712426 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf0e7-db99-4edc-976a-0cc059870afc None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.712704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf0e7-db99-4edc-976a-0cc059870afc None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.713892 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf0e7-db99-4edc-976a-0cc059870afc None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:55.715463 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf0e7-db99-4edc-976a-0cc059870afc None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:55.717439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 183/357] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:55 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:55.718020 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf0e7-db99-4edc-976a-0cc059870afc None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:55.784725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:55.800322 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6b729-73d2-4db8-84c7-0e3f1e9db435 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:55.844049 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf0e7-db99-4edc-976a-0cc059870afc None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:55.844246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25afdd3-bcca-4660-b001-d3005be4ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:55.845901 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afdd3-bcca-4660-b001-d3005be4ea77 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.846104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afdd3-bcca-4660-b001-d3005be4ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.846334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:55.846451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afdd3-bcca-4660-b001-d3005be4ea77 None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.855488 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25afdd3-bcca-4660-b001-d3005be4ea77 None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:55.857136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25afdd3-bcca-4660-b001-d3005be4ea77 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:55.861611 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 175/358] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:32:55 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:55.862496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25afdd3-bcca-4660-b001-d3005be4ea77 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:55.895131 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1be1f1-ae94-4730-80ef-72d508c55e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:55.896007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1be1f1-ae94-4730-80ef-72d508c55e16 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.896294 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1be1f1-ae94-4730-80ef-72d508c55e16 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.896575 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1be1f1-ae94-4730-80ef-72d508c55e16 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.898334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1be1f1-ae94-4730-80ef-72d508c55e16 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:55.901094 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1be1f1-ae94-4730-80ef-72d508c55e16 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:55.903997 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 184/359] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:55 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:55.906734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80381-34fc-4f7a-a949-34984e79ea83 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:55.910718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80381-34fc-4f7a-a949-34984e79ea83 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:55.911069 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e80381-34fc-4f7a-a949-34984e79ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:55.930962 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-e3e80381-34fc-4f7a-a949-34984e79ea83 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:55.932418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-e3e80381-34fc-4f7a-a949-34984e79ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:56.012344 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25afdd3-bcca-4660-b001-d3005be4ea77 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.027671 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 185/360] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:56.028529 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80381-34fc-4f7a-a949-34984e79ea83 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.058057 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.059040 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.059329 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.059688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.061008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:56.061325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:56.062786 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:56.074313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 176/361] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:56.075593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.099218 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:56.177809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:56.182917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e80381-34fc-4f7a-a949-34984e79ea83 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.211493 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d54e-2258-473a-adea-44cdaafd3fe5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.230861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9af04-c909-4233-9baa-e918a8344259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.231522 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9af04-c909-4233-9baa-e918a8344259 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.232070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9af04-c909-4233-9baa-e918a8344259 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.232474 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9af04-c909-4233-9baa-e918a8344259 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9af04-c909-4233-9baa-e918a8344259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:56.253222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2f70c-ae9a-432f-b9be-4848d103a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.254097 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2f70c-ae9a-432f-b9be-4848d103a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.254393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2f70c-ae9a-432f-b9be-4848d103a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.254713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2f70c-ae9a-432f-b9be-4848d103a7e1 None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-6fe9af04-c909-4233-9baa-e918a8344259 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:56.255317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:56.256249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 09:32:56.257063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:32:56.257660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2f70c-ae9a-432f-b9be-4848d103a7e1 None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:56.257726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 186/362] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:56.257726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9af04-c909-4233-9baa-e918a8344259 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.257848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2f70c-ae9a-432f-b9be-4848d103a7e1 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:56.259866 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 177/363] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:56.264184 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2f70c-ae9a-432f-b9be-4848d103a7e1 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.363294 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:56.379750 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2f70c-ae9a-432f-b9be-4848d103a7e1 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.387119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9af04-c909-4233-9baa-e918a8344259 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.422457 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3ffcd-dd53-4dc2-ad20-fec0c45f49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.423546 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3ffcd-dd53-4dc2-ad20-fec0c45f49d9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.423927 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3ffcd-dd53-4dc2-ad20-fec0c45f49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.424297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3ffcd-dd53-4dc2-ad20-fec0c45f49d9 None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.425621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3ffcd-dd53-4dc2-ad20-fec0c45f49d9 None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:56.427116 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3ffcd-dd53-4dc2-ad20-fec0c45f49d9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:56.427604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.428257 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.428544 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.428761 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 178/364] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:56.428850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.429538 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3ffcd-dd53-4dc2-ad20-fec0c45f49d9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.429634 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] RBAC: Adding query filter params (group.id=5f4b0ed5be7d494588bd49084a1ec095, role.id=fdcb4b876026440b87d75e4de6fdedcd, scope.project.id=d5c2839cdfc7453089ac16e62f08a110) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:56.429941 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:56.431401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:56.445764 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 187/365] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/role_assignments?group.id=5f4b0ed5be7d494588bd49084a1ec095&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=fdcb4b876026440b87d75e4de6fdedcd => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:56.445764 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.483004 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:56.570952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3ffcd-dd53-4dc2-ad20-fec0c45f49d9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.592920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39351-2ea4-45fb-a47a-342b6db8642a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.615041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fcfb9-c7aa-4948-9185-778e4e1d1ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.615861 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fcfb9-c7aa-4948-9185-778e4e1d1ef0 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.616142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fcfb9-c7aa-4948-9185-778e4e1d1ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.616410 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fcfb9-c7aa-4948-9185-778e4e1d1ef0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.629296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fcfb9-c7aa-4948-9185-778e4e1d1ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-d29fcfb9-c7aa-4948-9185-778e4e1d1ef0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:56.637062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:56.638127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:32:56.638952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:56.639890 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 179/366] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:56.640123 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fcfb9-c7aa-4948-9185-778e4e1d1ef0 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.646538 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bbed3-6026-48e6-b601-a138860b04dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.646723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbed3-6026-48e6-b601-a138860b04dd None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.646968 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbed3-6026-48e6-b601-a138860b04dd None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.647250 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbed3-6026-48e6-b601-a138860b04dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.660721 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:56.720691 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bbed3-6026-48e6-b601-a138860b04dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:56.722460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bbed3-6026-48e6-b601-a138860b04dd None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:56.749715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:56.755818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fcfb9-c7aa-4948-9185-778e4e1d1ef0 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.791644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.792334 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.792624 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.792907 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.793666 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] RBAC: Adding query filter params (name=reader) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:56.793979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:56.795443 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:56.805442 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 180/367] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:56.806111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.840414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 188/368] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:56.840414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bbed3-6026-48e6-b601-a138860b04dd None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.892290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:56.916017 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5153-c93d-4c67-bd30-9da48f14d1de None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.949672 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:56.949875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bbed3-6026-48e6-b601-a138860b04dd None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:56.950984 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:56.951648 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:56.952548 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:56.953392 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] RBAC: Adding query filter params (group.id=5f4b0ed5be7d494588bd49084a1ec095, role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=d5c2839cdfc7453089ac16e62f08a110) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:56.953709 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:56.955405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:56.966554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 181/369] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/role_assignments?group.id=5f4b0ed5be7d494588bd49084a1ec095&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:56.966554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:56.989212 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:57.000826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:57.002140 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:57.002509 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:57.002855 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:57.007143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] RBAC: Adding query filter params (group.id=5f4b0ed5be7d494588bd49084a1ec095, role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:57.007143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:57.007143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:57.012303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 189/370] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/role_assignments?group.id=5f4b0ed5be7d494588bd49084a1ec095&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:57.013330 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:57.164063 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fba70-d3f5-41b4-936d-8107dc913304 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:57.216381 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:57.216914 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:57.217213 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:57.217500 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:57.218264 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:57.220329 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:57.221033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:57.231026 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 182/371] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:32:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:57.231434 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:57.236726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:57.237115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004c48-5343-48c3-83ca-d4753483c977 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:57.301394 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58549e14-c0a9-4806-974f-6f115e49ad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:57.303046 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58549e14-c0a9-4806-974f-6f115e49ad84 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:57.303336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58549e14-c0a9-4806-974f-6f115e49ad84 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:57.303613 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58549e14-c0a9-4806-974f-6f115e49ad84 None admin] PATH_INFO: `/v3/users/7e5e04cf1762496fa8ff9ce4a0cab63b` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:57.304925 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58549e14-c0a9-4806-974f-6f115e49ad84 None admin] RBAC: Authorizing `identity:get_user(user_id=7e5e04cf1762496fa8ff9ce4a0cab63b)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:57.306371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58549e14-c0a9-4806-974f-6f115e49ad84 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:57.308036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 190/372] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Jul 25 09:32:57 2022] GET /identity/v3/users/7e5e04cf1762496fa8ff9ce4a0cab63b => generated 293 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:57.318962 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58549e14-c0a9-4806-974f-6f115e49ad84 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:57.407790 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:57.434278 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad770c-939e-483f-a0cc-d592f9766dc9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:57.455927 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58549e14-c0a9-4806-974f-6f115e49ad84 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:57.495015 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b489-58c9-4b3d-bf09-81323d880139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:57.495669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b489-58c9-4b3d-bf09-81323d880139 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:57.495948 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b489-58c9-4b3d-bf09-81323d880139 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:57.496225 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b489-58c9-4b3d-bf09-81323d880139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:57.503884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd29e6-5ea9-4294-bed4-561b3179076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:57.504763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd29e6-5ea9-4294-bed4-561b3179076c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:57.505054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd29e6-5ea9-4294-bed4-561b3179076c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:57.505336 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd29e6-5ea9-4294-bed4-561b3179076c None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:57.512816 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd29e6-5ea9-4294-bed4-561b3179076c None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:57.514313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd29e6-5ea9-4294-bed4-561b3179076c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:57.517100 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 183/373] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:57 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:57.517901 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd29e6-5ea9-4294-bed4-561b3179076c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:57.627417 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b489-58c9-4b3d-bf09-81323d880139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:57.628882 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b489-58c9-4b3d-bf09-81323d880139 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:57.632203 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:57.685612 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd29e6-5ea9-4294-bed4-561b3179076c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:57.714491 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:57.748857 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:57.749552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:57.749814 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:57.752454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:57.752454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] RBAC: Adding query filter params (role.id=da936e597e164c0e9a53de44f160bc12, user.id=7e5e04cf1762496fa8ff9ce4a0cab63b, scope.system=all) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:57.752454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:57.752796 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:57.783054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 184/374] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Jul 25 09:32:57 2022] GET /identity/v3/role_assignments?user.id=7e5e04cf1762496fa8ff9ce4a0cab63b&scope.system=all&role.id=da936e597e164c0e9a53de44f160bc12 => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:57.784277 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:57.806580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 191/375] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:32:57.812214 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b489-58c9-4b3d-bf09-81323d880139 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:58.009332 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a110b-6065-4efd-9bbf-b71a6c6b440e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:58.036742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b489-58c9-4b3d-bf09-81323d880139 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:58.063991 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:58.082136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c292-8706-46bc-95f6-335d8f6c72ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:58.083189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c292-8706-46bc-95f6-335d8f6c72ea None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:58.083480 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c292-8706-46bc-95f6-335d8f6c72ea None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:58.083759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71c292-8706-46bc-95f6-335d8f6c72ea None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:58.088723 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71c292-8706-46bc-95f6-335d8f6c72ea None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:58.090386 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71c292-8706-46bc-95f6-335d8f6c72ea None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:58.096599 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 185/376] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:32:57 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:58.099322 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c292-8706-46bc-95f6-335d8f6c72ea None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:58.111090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf3bb-3a16-43e3-88bf-3b81cf108755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:58.111946 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf3bb-3a16-43e3-88bf-3b81cf108755 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:58.112702 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf3bb-3a16-43e3-88bf-3b81cf108755 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:58.112993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaf3bb-3a16-43e3-88bf-3b81cf108755 None admin] PATH_INFO: `/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:58.114366 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaf3bb-3a16-43e3-88bf-3b81cf108755 None admin] RBAC: Authorizing `identity:get_project(project_id=81ad3fb6bc2540d4880f089b3fb44ef8)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:58.115861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaf3bb-3a16-43e3-88bf-3b81cf108755 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:58.117608 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 192/377] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:32:57 2022] GET /identity/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8 => generated 344 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:58.123864 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf3bb-3a16-43e3-88bf-3b81cf108755 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:58.170831 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:58.294660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71c292-8706-46bc-95f6-335d8f6c72ea None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:58.312478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaf3bb-3a16-43e3-88bf-3b81cf108755 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:58.360529 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab53c7-5977-43ec-9135-d22bcb9714db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:58.361432 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab53c7-5977-43ec-9135-d22bcb9714db None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:58.361723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab53c7-5977-43ec-9135-d22bcb9714db None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:58.362005 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab53c7-5977-43ec-9135-d22bcb9714db None admin] PATH_INFO: `/v3/groups/6de88f5ec7184de3985e0f73565c809b` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:58.362990 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252b60f-f592-4ea8-8e59-521d981eafd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:58.363729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252b60f-f592-4ea8-8e59-521d981eafd9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:58.364011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252b60f-f592-4ea8-8e59-521d981eafd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:58.364289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252b60f-f592-4ea8-8e59-521d981eafd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:58.365162 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252b60f-f592-4ea8-8e59-521d981eafd9 None admin] RBAC: Adding query filter params (group.id=5f4b0ed5be7d494588bd49084a1ec095, role.id=fdcb4b876026440b87d75e4de6fdedcd, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:58.365481 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252b60f-f592-4ea8-8e59-521d981eafd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:58.367019 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252b60f-f592-4ea8-8e59-521d981eafd9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:58.378111 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab53c7-5977-43ec-9135-d22bcb9714db None admin] RBAC: Authorizing `identity:get_group(group_id=6de88f5ec7184de3985e0f73565c809b)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:58.379639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab53c7-5977-43ec-9135-d22bcb9714db None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:58.381854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 193/378] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:32:58 2022] GET /identity/v3/groups/6de88f5ec7184de3985e0f73565c809b => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:58.383950 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 186/379] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:32:58 2022] GET /identity/v3/role_assignments?group.id=5f4b0ed5be7d494588bd49084a1ec095&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=fdcb4b876026440b87d75e4de6fdedcd => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:32:58.388819 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab53c7-5977-43ec-9135-d22bcb9714db None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:58.490038 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:58.503095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab53c7-5977-43ec-9135-d22bcb9714db None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:58.542723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95020f7-0613-4903-810e-50d89248360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:58.543397 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95020f7-0613-4903-810e-50d89248360f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:58.543684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95020f7-0613-4903-810e-50d89248360f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:58.543966 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95020f7-0613-4903-810e-50d89248360f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:58.544854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95020f7-0613-4903-810e-50d89248360f None admin] RBAC: Adding query filter params (group.id=6de88f5ec7184de3985e0f73565c809b, role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=81ad3fb6bc2540d4880f089b3fb44ef8) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:58.545108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95020f7-0613-4903-810e-50d89248360f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:58.546597 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95020f7-0613-4903-810e-50d89248360f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:58.553342 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 194/380] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:32:58 2022] GET /identity/v3/role_assignments?group.id=6de88f5ec7184de3985e0f73565c809b&scope.project.id=81ad3fb6bc2540d4880f089b3fb44ef8&role.id=bd8b88fae376413398183761500b2e1d => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:59.337656 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b4eba-ed70-41f4-a660-0dff5a9729d3 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:59.338545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b4eba-ed70-41f4-a660-0dff5a9729d3 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:59.339047 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b4eba-ed70-41f4-a660-0dff5a9729d3 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:59.340879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 187/381] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:59.346283 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56bf6-a59c-40d9-b1cc-d777f7eaee74 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:59.346847 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56bf6-a59c-40d9-b1cc-d777f7eaee74 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:59.347322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56bf6-a59c-40d9-b1cc-d777f7eaee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:59.375505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-2eb56bf6-a59c-40d9-b1cc-d777f7eaee74 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:59.377843 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-2eb56bf6-a59c-40d9-b1cc-d777f7eaee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:59.463945 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 195/382] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:32:59.502209 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b4eba-ed70-41f4-a660-0dff5a9729d3 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:59.577670 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:59.628216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b4eba-ed70-41f4-a660-0dff5a9729d3 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:59.680873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2318c-5d15-49de-8fbf-1b301e3a11d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:59.682093 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2318c-5d15-49de-8fbf-1b301e3a11d0 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:59.682636 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2318c-5d15-49de-8fbf-1b301e3a11d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:59.683111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2318c-5d15-49de-8fbf-1b301e3a11d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:59.704842 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2318c-5d15-49de-8fbf-1b301e3a11d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-a9c2318c-5d15-49de-8fbf-1b301e3a11d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:32:59.713637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:32:59.714528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:32:59.715327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:32:59.717603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 188/383] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:32:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:32:59.724034 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb56bf6-a59c-40d9-b1cc-d777f7eaee74 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:59.783536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84f4dd-cf21-4ff4-9b96-2668ea446cc5 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:59.784165 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84f4dd-cf21-4ff4-9b96-2668ea446cc5 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:59.784669 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84f4dd-cf21-4ff4-9b96-2668ea446cc5 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:59.786220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 189/384] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:59.812237 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4822ca-7b19-4985-b66d-9c8f507372a1 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:59.812807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4822ca-7b19-4985-b66d-9c8f507372a1 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:59.813369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4822ca-7b19-4985-b66d-9c8f507372a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:59.836633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:32:59.855804 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-ef4822ca-7b19-4985-b66d-9c8f507372a1 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:59.857033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-ef4822ca-7b19-4985-b66d-9c8f507372a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:32:59.857456 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb56bf6-a59c-40d9-b1cc-d777f7eaee74 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:32:59.909197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece522f-a45b-46f4-8756-380ba668a5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:32:59.909797 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece522f-a45b-46f4-8756-380ba668a5a5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:59.910250 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece522f-a45b-46f4-8756-380ba668a5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:59.910578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece522f-a45b-46f4-8756-380ba668a5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:59.911339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece522f-a45b-46f4-8756-380ba668a5a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:32:59.911650 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece522f-a45b-46f4-8756-380ba668a5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:32:59.914260 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece522f-a45b-46f4-8756-380ba668a5a5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:32:59.924513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 196/385] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:32:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:32:59.925821 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71aa5-c889-488b-a5af-1939468e3455 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:59.926118 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71aa5-c889-488b-a5af-1939468e3455 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:59.926404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71aa5-c889-488b-a5af-1939468e3455 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:59.927752 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 197/386] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:32:59.931312 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b71aa5-c889-488b-a5af-1939468e3455 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:32:59.958117 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 190/387] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:32:59.961813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d3aa8-057c-49ba-a2cc-a0229b6951a0 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:32:59.961813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d3aa8-057c-49ba-a2cc-a0229b6951a0 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:32:59.961813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d3aa8-057c-49ba-a2cc-a0229b6951a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:32:59.979652 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-317d3aa8-057c-49ba-a2cc-a0229b6951a0 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:32:59.986496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-317d3aa8-057c-49ba-a2cc-a0229b6951a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:00.035990 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:00.061120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 191/388] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:00.062025 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d3aa8-057c-49ba-a2cc-a0229b6951a0 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.078123 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b71aa5-c889-488b-a5af-1939468e3455 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.124268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db8b8c-ae73-4257-a103-5cf5926b317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.125159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8b8c-ae73-4257-a103-5cf5926b317c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.125450 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8b8c-ae73-4257-a103-5cf5926b317c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.126372 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db8b8c-ae73-4257-a103-5cf5926b317c None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.128050 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db8b8c-ae73-4257-a103-5cf5926b317c None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:00.129559 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db8b8c-ae73-4257-a103-5cf5926b317c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:00.131346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 198/389] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:32:59 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:00.132156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db8b8c-ae73-4257-a103-5cf5926b317c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.155089 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:00.224721 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d3aa8-057c-49ba-a2cc-a0229b6951a0 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.261416 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db8b8c-ae73-4257-a103-5cf5926b317c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.268469 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe8d72-ba5f-4dd7-b80c-2be7fe2d2ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.269402 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8d72-ba5f-4dd7-b80c-2be7fe2d2ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.269691 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8d72-ba5f-4dd7-b80c-2be7fe2d2ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.269970 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8d72-ba5f-4dd7-b80c-2be7fe2d2ae5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.282405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe8d72-ba5f-4dd7-b80c-2be7fe2d2ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-fbfe8d72-ba5f-4dd7-b80c-2be7fe2d2ae5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:00.291037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:00.291966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 192/390] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:00.293568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe8d72-ba5f-4dd7-b80c-2be7fe2d2ae5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.306840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dcae0-b78a-445b-89fc-03271c37b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.307974 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dcae0-b78a-445b-89fc-03271c37b199 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.308535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dcae0-b78a-445b-89fc-03271c37b199 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.309051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dcae0-b78a-445b-89fc-03271c37b199 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.321181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dcae0-b78a-445b-89fc-03271c37b199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-4f8dcae0-b78a-445b-89fc-03271c37b199 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:00.330531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:00.331666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:33:00.332447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:00.334943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 199/391] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:00.336836 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dcae0-b78a-445b-89fc-03271c37b199 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.345288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:00.418049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe8d72-ba5f-4dd7-b80c-2be7fe2d2ae5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.425676 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:00.455688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944de0b-1ed9-4b1f-96ae-8722e908f3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.457202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944de0b-1ed9-4b1f-96ae-8722e908f3b4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.457776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944de0b-1ed9-4b1f-96ae-8722e908f3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.458260 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944de0b-1ed9-4b1f-96ae-8722e908f3b4 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.458713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dcae0-b78a-445b-89fc-03271c37b199 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.459926 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944de0b-1ed9-4b1f-96ae-8722e908f3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:00.461602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944de0b-1ed9-4b1f-96ae-8722e908f3b4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:00.464122 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 193/392] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:00.465238 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944de0b-1ed9-4b1f-96ae-8722e908f3b4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.495695 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.496314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.496598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.496864 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.497609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:00.497919 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:00.499319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:00.508231 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 200/393] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:00.512973 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.606304 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944de0b-1ed9-4b1f-96ae-8722e908f3b4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.616882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:00.636494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40732ad5-ee0b-4631-a9fa-301956af10a8 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.646119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.646947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.647529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.647529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.648435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:00.649120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:00.651022 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:00.661348 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 194/394] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:00.666796 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.685690 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa47b3-20ed-4209-a804-f5c806d41702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.687143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa47b3-20ed-4209-a804-f5c806d41702 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.687583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa47b3-20ed-4209-a804-f5c806d41702 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.688437 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa47b3-20ed-4209-a804-f5c806d41702 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110/groups/5f4b0ed5be7d494588bd49084a1ec095/roles/fdcb4b876026440b87d75e4de6fdedcd` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.691065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa47b3-20ed-4209-a804-f5c806d41702 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5c2839cdfc7453089ac16e62f08a110, group_id=5f4b0ed5be7d494588bd49084a1ec095, role_id=fdcb4b876026440b87d75e4de6fdedcd)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:00.693513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa47b3-20ed-4209-a804-f5c806d41702 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:00.697147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:00.772296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 201/395] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Jul 25 09:33:00 2022] PUT /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110/groups/5f4b0ed5be7d494588bd49084a1ec095/roles/fdcb4b876026440b87d75e4de6fdedcd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:00.774871 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa47b3-20ed-4209-a804-f5c806d41702 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.776169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb485c-0a28-4aa3-b7a7-3d71f665d9c1 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.817470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cf820-d3a6-460c-8d0a-d0632fcdedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.818599 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf820-d3a6-460c-8d0a-d0632fcdedce None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.818902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf820-d3a6-460c-8d0a-d0632fcdedce None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.819289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cf820-d3a6-460c-8d0a-d0632fcdedce None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.820900 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cf820-d3a6-460c-8d0a-d0632fcdedce None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:00.822576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cf820-d3a6-460c-8d0a-d0632fcdedce None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:00.824673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 195/396] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:00.831008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cf820-d3a6-460c-8d0a-d0632fcdedce None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:00.871892 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:00.925095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa47b3-20ed-4209-a804-f5c806d41702 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.944316 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cf820-d3a6-460c-8d0a-d0632fcdedce None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:00.965665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ea4ad-1357-4a14-a55b-302f17802e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:00.967150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ea4ad-1357-4a14-a55b-302f17802e82 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:00.967756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ea4ad-1357-4a14-a55b-302f17802e82 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:00.968241 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ea4ad-1357-4a14-a55b-302f17802e82 None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:00.970724 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ea4ad-1357-4a14-a55b-302f17802e82 None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:00.972468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ea4ad-1357-4a14-a55b-302f17802e82 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:00.974980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 202/397] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:00.986799 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ea4ad-1357-4a14-a55b-302f17802e82 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:01.007195 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474dcc-0fbe-4234-b894-0f5811c1c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:01.008077 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474dcc-0fbe-4234-b894-0f5811c1c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.008364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474dcc-0fbe-4234-b894-0f5811c1c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.008644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474dcc-0fbe-4234-b894-0f5811c1c4e6 None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.011209 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87474dcc-0fbe-4234-b894-0f5811c1c4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:01.012680 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87474dcc-0fbe-4234-b894-0f5811c1c4e6 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:01.014678 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 196/398] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:01.022833 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474dcc-0fbe-4234-b894-0f5811c1c4e6 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:01.114880 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:01.147341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474dcc-0fbe-4234-b894-0f5811c1c4e6 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:01.149754 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:01.162120 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ea4ad-1357-4a14-a55b-302f17802e82 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:01.185751 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed521a-5112-449f-8aa8-1988f0ef8a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:01.186769 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed521a-5112-449f-8aa8-1988f0ef8a0f None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.187112 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed521a-5112-449f-8aa8-1988f0ef8a0f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.187404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed521a-5112-449f-8aa8-1988f0ef8a0f None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110/groups/5f4b0ed5be7d494588bd49084a1ec095/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.190038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed521a-5112-449f-8aa8-1988f0ef8a0f None admin] RBAC: Authorizing `identity:create_grant(project_id=d5c2839cdfc7453089ac16e62f08a110, group_id=5f4b0ed5be7d494588bd49084a1ec095, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:01.191527 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed521a-5112-449f-8aa8-1988f0ef8a0f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:01.204511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76274d9-6f91-40b6-84da-4489481e9f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:01.205616 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76274d9-6f91-40b6-84da-4489481e9f75 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.206002 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76274d9-6f91-40b6-84da-4489481e9f75 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.207059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76274d9-6f91-40b6-84da-4489481e9f75 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.208726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76274d9-6f91-40b6-84da-4489481e9f75 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:01.210490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76274d9-6f91-40b6-84da-4489481e9f75 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:01.213267 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 203/399] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:00 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:01.220767 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76274d9-6f91-40b6-84da-4489481e9f75 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:01.291027 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 197/400] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Jul 25 09:33:01 2022] PUT /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110/groups/5f4b0ed5be7d494588bd49084a1ec095/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:33:01.292736 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1468a-42ba-450d-b8a6-7abb5800e9ce None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.293247 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1468a-42ba-450d-b8a6-7abb5800e9ce None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.293760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1468a-42ba-450d-b8a6-7abb5800e9ce None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.295400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 198/401] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:01.306104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f8d4-d218-446f-a55d-7348a1bd8856 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.306828 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f8d4-d218-446f-a55d-7348a1bd8856 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.308413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56f8d4-d218-446f-a55d-7348a1bd8856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.352569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-3e56f8d4-d218-446f-a55d-7348a1bd8856 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:01.353989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-3e56f8d4-d218-446f-a55d-7348a1bd8856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:01.396314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76274d9-6f91-40b6-84da-4489481e9f75 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:01.436335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:01.446404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37655a7e-874c-471b-966f-4e02cdcc2b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:01.448234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37655a7e-874c-471b-966f-4e02cdcc2b31 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.448830 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37655a7e-874c-471b-966f-4e02cdcc2b31 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.449361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37655a7e-874c-471b-966f-4e02cdcc2b31 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/groups/5f4b0ed5be7d494588bd49084a1ec095/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.452448 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37655a7e-874c-471b-966f-4e02cdcc2b31 None admin] RBAC: Authorizing `identity:create_grant(project_id=688bf756f62c4e97a15b6887b5f90f2f, group_id=5f4b0ed5be7d494588bd49084a1ec095, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:01.454810 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37655a7e-874c-471b-966f-4e02cdcc2b31 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:01.466498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 199/402] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:01.466498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3ea4-9785-43df-bedc-2aa23eed2163 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.466498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3ea4-9785-43df-bedc-2aa23eed2163 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.466498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3ea4-9785-43df-bedc-2aa23eed2163 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.467486 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 200/403] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:01.469202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f525-4452-4002-8680-152579cd4878 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.469202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f525-4452-4002-8680-152579cd4878 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.469727 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71f525-4452-4002-8680-152579cd4878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.492937 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-cd71f525-4452-4002-8680-152579cd4878 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:01.494177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-cd71f525-4452-4002-8680-152579cd4878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:01.562066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 204/404] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Jul 25 09:33:01 2022] PUT /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/groups/5f4b0ed5be7d494588bd49084a1ec095/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:01.562998 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37655a7e-874c-471b-966f-4e02cdcc2b31 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:01.578413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 201/405] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:01.617872 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f525-4452-4002-8680-152579cd4878 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:01.660317 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:01.723748 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37655a7e-874c-471b-966f-4e02cdcc2b31 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:01.763568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cec17-9c9a-4ac8-a5ae-d196aa0785cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:01.764780 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cec17-9c9a-4ac8-a5ae-d196aa0785cf None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.765269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cec17-9c9a-4ac8-a5ae-d196aa0785cf None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.765745 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cec17-9c9a-4ac8-a5ae-d196aa0785cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.778920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cec17-9c9a-4ac8-a5ae-d196aa0785cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-be4cec17-9c9a-4ac8-a5ae-d196aa0785cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:01.788749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:01.789681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:33:01.790602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:01.793118 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 205/406] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:01.800109 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cec17-9c9a-4ac8-a5ae-d196aa0785cf None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:01.820256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71f525-4452-4002-8680-152579cd4878 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:01.862768 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:01.872143 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc253574-58e8-45e5-9a98-dc5e8c013da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:01.873000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc253574-58e8-45e5-9a98-dc5e8c013da5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.873419 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc253574-58e8-45e5-9a98-dc5e8c013da5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.879338 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc253574-58e8-45e5-9a98-dc5e8c013da5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.892421 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc253574-58e8-45e5-9a98-dc5e8c013da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-cc253574-58e8-45e5-9a98-dc5e8c013da5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:01.902707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:01.903726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:01.904529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 202/407] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:01.911045 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc253574-58e8-45e5-9a98-dc5e8c013da5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:01.922176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cec17-9c9a-4ac8-a5ae-d196aa0785cf None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:01.961527 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:01.962259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:01.962577 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:01.962914 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:01.963671 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:01.964059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:01.966760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:01.977320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 206/408] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:01.997357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:02.018811 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:02.050948 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc253574-58e8-45e5-9a98-dc5e8c013da5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:02.127358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:02.128048 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:02.128389 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:02.128678 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:02.129445 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:02.129759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:02.131239 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:02.150065 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 203/409] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:02.159861 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:02.174791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084564-6b07-4f0a-a5ff-6fd690672302 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:02.198522 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:02.253461 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077340d-c8ae-4043-bab0-3bc57a81bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:02.254344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077340d-c8ae-4043-bab0-3bc57a81bafc None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:02.254664 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077340d-c8ae-4043-bab0-3bc57a81bafc None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:02.254945 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077340d-c8ae-4043-bab0-3bc57a81bafc None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:02.256141 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077340d-c8ae-4043-bab0-3bc57a81bafc None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:02.257597 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077340d-c8ae-4043-bab0-3bc57a81bafc None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:02.259555 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 207/410] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:01 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:02.265242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077340d-c8ae-4043-bab0-3bc57a81bafc None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:02.323419 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b48f4-e75e-4f76-b40e-87bd0026059d None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:02.368330 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46975-5b9b-4b1a-a05a-e28f09f4bd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:02.369202 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46975-5b9b-4b1a-a05a-e28f09f4bd59 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:02.369491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46975-5b9b-4b1a-a05a-e28f09f4bd59 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:02.370300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46975-5b9b-4b1a-a05a-e28f09f4bd59 None admin] PATH_INFO: `/v3/groups/6de88f5ec7184de3985e0f73565c809b` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:02.375611 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f46975-5b9b-4b1a-a05a-e28f09f4bd59 None admin] RBAC: Authorizing `identity:get_group(group_id=6de88f5ec7184de3985e0f73565c809b)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:02.377179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f46975-5b9b-4b1a-a05a-e28f09f4bd59 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:02.383251 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 204/411] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:02 2022] GET /identity/v3/groups/6de88f5ec7184de3985e0f73565c809b => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:02.400178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46975-5b9b-4b1a-a05a-e28f09f4bd59 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:02.430083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:02.450582 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077340d-c8ae-4043-bab0-3bc57a81bafc None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:02.490629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acce21-7738-4295-a69b-00408b1e16f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:02.491548 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acce21-7738-4295-a69b-00408b1e16f3 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:02.491841 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acce21-7738-4295-a69b-00408b1e16f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:02.492120 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acce21-7738-4295-a69b-00408b1e16f3 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:02.493312 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acce21-7738-4295-a69b-00408b1e16f3 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:02.494784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acce21-7738-4295-a69b-00408b1e16f3 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:02.496922 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 208/412] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:02 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:02.502973 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acce21-7738-4295-a69b-00408b1e16f3 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:02.587845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f46975-5b9b-4b1a-a05a-e28f09f4bd59 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:02.608839 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:02.636624 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ad79-00c7-4373-a247-64f84f89c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:02.637405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ad79-00c7-4373-a247-64f84f89c407 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:02.637690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ad79-00c7-4373-a247-64f84f89c407 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:02.637968 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ad79-00c7-4373-a247-64f84f89c407 None admin] PATH_INFO: `/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:02.639235 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0ad79-00c7-4373-a247-64f84f89c407 None admin] RBAC: Authorizing `identity:get_project(project_id=81ad3fb6bc2540d4880f089b3fb44ef8)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:02.640673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0ad79-00c7-4373-a247-64f84f89c407 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:02.643451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 205/413] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:02 2022] GET /identity/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8 => generated 344 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:02.649934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ad79-00c7-4373-a247-64f84f89c407 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:02.716179 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acce21-7738-4295-a69b-00408b1e16f3 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:02.786546 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:02.807194 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ad79-00c7-4373-a247-64f84f89c407 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:02.832072 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc08808-cce4-4ff7-8dfa-ccbd005abbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:02.832990 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08808-cce4-4ff7-8dfa-ccbd005abbe3 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:02.833283 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08808-cce4-4ff7-8dfa-ccbd005abbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:02.833566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08808-cce4-4ff7-8dfa-ccbd005abbe3 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/groups/5f4b0ed5be7d494588bd49084a1ec095/roles/fdcb4b876026440b87d75e4de6fdedcd` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:02.836465 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc08808-cce4-4ff7-8dfa-ccbd005abbe3 None admin] RBAC: Authorizing `identity:create_grant(project_id=688bf756f62c4e97a15b6887b5f90f2f, group_id=5f4b0ed5be7d494588bd49084a1ec095, role_id=fdcb4b876026440b87d75e4de6fdedcd)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:02.837936 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc08808-cce4-4ff7-8dfa-ccbd005abbe3 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:02.849102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd4b0-9b91-48c1-b596-49146353bc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:02.850327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd4b0-9b91-48c1-b596-49146353bc7e None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:02.850861 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd4b0-9b91-48c1-b596-49146353bc7e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:02.851673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd4b0-9b91-48c1-b596-49146353bc7e None admin] PATH_INFO: `/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8/groups/6de88f5ec7184de3985e0f73565c809b/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:02.854929 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edd4b0-9b91-48c1-b596-49146353bc7e None admin] RBAC: Authorizing `identity:create_grant(project_id=81ad3fb6bc2540d4880f089b3fb44ef8, group_id=6de88f5ec7184de3985e0f73565c809b, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:02.856648 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edd4b0-9b91-48c1-b596-49146353bc7e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:02.924361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 209/414] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Jul 25 09:33:02 2022] PUT /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f/groups/5f4b0ed5be7d494588bd49084a1ec095/roles/fdcb4b876026440b87d75e4de6fdedcd => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:02.953483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 206/415] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Jul 25 09:33:02 2022] PUT /identity/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8/groups/6de88f5ec7184de3985e0f73565c809b/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:03.675134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad0f99-b39a-4003-835d-0066bde32961 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:03.675321 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad0f99-b39a-4003-835d-0066bde32961 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:03.675601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad0f99-b39a-4003-835d-0066bde32961 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:03.676966 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 210/416] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:03.682886 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423605-6c62-4ee2-a74b-4a8a510dccb8 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:03.683387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423605-6c62-4ee2-a74b-4a8a510dccb8 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:03.683462 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b423605-6c62-4ee2-a74b-4a8a510dccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:03.704873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-8b423605-6c62-4ee2-a74b-4a8a510dccb8 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:03.706059 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-8b423605-6c62-4ee2-a74b-4a8a510dccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:03.802766 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 207/417] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:03.827208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad0f99-b39a-4003-835d-0066bde32961 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:03.966536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479bdb-baa3-4210-884c-ddacc827ded1 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:03.966869 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479bdb-baa3-4210-884c-ddacc827ded1 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:03.967036 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479bdb-baa3-4210-884c-ddacc827ded1 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:03.968397 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 208/418] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:03.973954 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0ec73-aeeb-448b-868e-47e9a27cffce None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:03.974243 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0ec73-aeeb-448b-868e-47e9a27cffce None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:03.974553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0ec73-aeeb-448b-868e-47e9a27cffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:03.999240 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad0f99-b39a-4003-835d-0066bde32961 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:04.001681 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-e2d0ec73-aeeb-448b-868e-47e9a27cffce None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:04.002890 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-e2d0ec73-aeeb-448b-868e-47e9a27cffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:04.013462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:04.063924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be34f-429a-488f-babe-02d1b3de0dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:04.064741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be34f-429a-488f-babe-02d1b3de0dc3 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.065028 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be34f-429a-488f-babe-02d1b3de0dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.065309 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be34f-429a-488f-babe-02d1b3de0dc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.092018 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64be34f-429a-488f-babe-02d1b3de0dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-a64be34f-429a-488f-babe-02d1b3de0dc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:04.100809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:04.101694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:33:04.102584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:04.118729 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 211/419] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:04.133138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be34f-429a-488f-babe-02d1b3de0dc3 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:04.143108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 209/420] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:33:04.168536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0ec73-aeeb-448b-868e-47e9a27cffce None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:04.170962 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:04.280759 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be34f-429a-488f-babe-02d1b3de0dc3 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:04.354068 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f0ec5-33ee-4e64-9ac9-c38905fa1500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:04.354792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0ec5-33ee-4e64-9ac9-c38905fa1500 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.355074 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0ec5-33ee-4e64-9ac9-c38905fa1500 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.355351 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f0ec5-33ee-4e64-9ac9-c38905fa1500 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.356208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f0ec5-33ee-4e64-9ac9-c38905fa1500 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:04.356520 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f0ec5-33ee-4e64-9ac9-c38905fa1500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:04.358088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f0ec5-33ee-4e64-9ac9-c38905fa1500 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:04.368350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 212/421] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:04.369697 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051c87-1d60-424e-8e51-438c330b5f2e None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.369992 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051c87-1d60-424e-8e51-438c330b5f2e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.370271 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051c87-1d60-424e-8e51-438c330b5f2e None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.376224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 213/422] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:04.377684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312f475-ddb2-4593-9a6f-b2b6565b5d5c None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.377974 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312f475-ddb2-4593-9a6f-b2b6565b5d5c None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.378253 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312f475-ddb2-4593-9a6f-b2b6565b5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.379005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0ec73-aeeb-448b-868e-47e9a27cffce None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:04.397480 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-5312f475-ddb2-4593-9a6f-b2b6565b5d5c None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:04.398698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-5312f475-ddb2-4593-9a6f-b2b6565b5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:04.415688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f212a4-4188-4009-815b-e427b3988e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:04.417127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f212a4-4188-4009-815b-e427b3988e0f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.417431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f212a4-4188-4009-815b-e427b3988e0f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.417713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f212a4-4188-4009-815b-e427b3988e0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.431642 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f212a4-4188-4009-815b-e427b3988e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:04.432227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-05f212a4-4188-4009-815b-e427b3988e0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:04.442495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:04.443372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:04.444159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 210/423] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:04.445410 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f212a4-4188-4009-815b-e427b3988e0f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:04.493619 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 214/424] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:04.498634 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312f475-ddb2-4593-9a6f-b2b6565b5d5c None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:04.534143 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:04.580247 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f212a4-4188-4009-815b-e427b3988e0f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:04.617287 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312f475-ddb2-4593-9a6f-b2b6565b5d5c None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:04.618085 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb3a4a-8eff-488e-948d-64186665632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:04.618955 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb3a4a-8eff-488e-948d-64186665632f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.619382 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb3a4a-8eff-488e-948d-64186665632f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.619847 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb3a4a-8eff-488e-948d-64186665632f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.653840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:04.654538 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.654838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.655109 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.655847 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] RBAC: Adding query filter params (name=member) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:04.656153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:04.658338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:04.671375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 215/425] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:04.672265 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:04.697115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb3a4a-8eff-488e-948d-64186665632f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:04.699270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb3a4a-8eff-488e-948d-64186665632f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:04.730930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:04.763952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:04.775460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84e283-8331-4345-aa83-566fa24e81bc None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:04.806146 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 211/426] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:04.807287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb3a4a-8eff-488e-948d-64186665632f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:04.816668 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b5cab-f358-4e6a-85ec-ea4443b354ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:04.817479 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b5cab-f358-4e6a-85ec-ea4443b354ad None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.817767 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b5cab-f358-4e6a-85ec-ea4443b354ad None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.818038 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b5cab-f358-4e6a-85ec-ea4443b354ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.829382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b5cab-f358-4e6a-85ec-ea4443b354ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-b02b5cab-f358-4e6a-85ec-ea4443b354ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:04.837598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:04.838535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 09:33:04.839323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:04.842580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 216/427] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:04.843421 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b5cab-f358-4e6a-85ec-ea4443b354ad None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:04.924534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb3a4a-8eff-488e-948d-64186665632f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:04.932183 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:04.951791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b5cab-f358-4e6a-85ec-ea4443b354ad None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:04.963520 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221216-c126-48ef-bb31-563c13f00426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:04.964450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221216-c126-48ef-bb31-563c13f00426 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.964875 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221216-c126-48ef-bb31-563c13f00426 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.965292 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221216-c126-48ef-bb31-563c13f00426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.989117 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200f95-3283-472e-a659-d293a970465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:04.989991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200f95-3283-472e-a659-d293a970465c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:04.990280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200f95-3283-472e-a659-d293a970465c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:04.990591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200f95-3283-472e-a659-d293a970465c None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:04.991811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200f95-3283-472e-a659-d293a970465c None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:04.993298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200f95-3283-472e-a659-d293a970465c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:04.999669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 217/428] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:04 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:05.001143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200f95-3283-472e-a659-d293a970465c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.003129 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:05.046114 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40221216-c126-48ef-bb31-563c13f00426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.048610 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40221216-c126-48ef-bb31-563c13f00426 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.107768 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200f95-3283-472e-a659-d293a970465c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:05.143326 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:05.143996 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.144286 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.144566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.145570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] RBAC: Adding query filter params (name=member) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:05.145684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.147025 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.160850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 218/429] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:05.161764 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.167355 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 212/430] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:05.168348 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221216-c126-48ef-bb31-563c13f00426 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.182348 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:05.237487 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:05.275235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0c10d-35c9-4a55-b7b4-b84b96080987 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:05.286120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221216-c126-48ef-bb31-563c13f00426 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:05.312568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27536-7930-4727-9239-e91b1c8bdfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:05.313991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27536-7930-4727-9239-e91b1c8bdfb3 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.314352 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27536-7930-4727-9239-e91b1c8bdfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.314667 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec27536-7930-4727-9239-e91b1c8bdfb3 None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.315921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec27536-7930-4727-9239-e91b1c8bdfb3 None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.317318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec27536-7930-4727-9239-e91b1c8bdfb3 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.323974 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 219/431] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:05.324831 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27536-7930-4727-9239-e91b1c8bdfb3 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.327540 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c3825-7e8f-4cb7-81a3-1eada17ffd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:05.328466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c3825-7e8f-4cb7-81a3-1eada17ffd48 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.329098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c3825-7e8f-4cb7-81a3-1eada17ffd48 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.329503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c3825-7e8f-4cb7-81a3-1eada17ffd48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.410611 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:05.414836 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c3825-7e8f-4cb7-81a3-1eada17ffd48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.416655 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c3825-7e8f-4cb7-81a3-1eada17ffd48 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.430751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec27536-7930-4727-9239-e91b1c8bdfb3 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:05.467340 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04296-4649-4e85-a9ce-303059ab45ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:05.468493 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04296-4649-4e85-a9ce-303059ab45ad None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.468781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04296-4649-4e85-a9ce-303059ab45ad None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.469761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04296-4649-4e85-a9ce-303059ab45ad None admin] PATH_INFO: `/v3/projects/d5c2839cdfc7453089ac16e62f08a110` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.471345 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04296-4649-4e85-a9ce-303059ab45ad None admin] RBAC: Authorizing `identity:get_project(project_id=d5c2839cdfc7453089ac16e62f08a110)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.472790 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04296-4649-4e85-a9ce-303059ab45ad None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.479726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 220/432] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/projects/d5c2839cdfc7453089ac16e62f08a110 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:05.480513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04296-4649-4e85-a9ce-303059ab45ad None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.482293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:05.527577 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 213/433] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:05.528715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52e9e-f90a-483f-91a8-3ec6b4891782 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.529006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52e9e-f90a-483f-91a8-3ec6b4891782 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.529284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a52e9e-f90a-483f-91a8-3ec6b4891782 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.534940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 214/434] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:05.534940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a52e9e-f90a-483f-91a8-3ec6b4891782 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.602449 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04296-4649-4e85-a9ce-303059ab45ad None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:05.644263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a52e9e-f90a-483f-91a8-3ec6b4891782 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:05.648158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:05.648982 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.649441 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.649862 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.650850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] RBAC: Adding query filter params (group.id=5f4b0ed5be7d494588bd49084a1ec095, role.id=fdcb4b876026440b87d75e4de6fdedcd, scope.project.id=d5c2839cdfc7453089ac16e62f08a110) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:05.651303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.653269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.661411 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 221/435] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/role_assignments?group.id=5f4b0ed5be7d494588bd49084a1ec095&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=fdcb4b876026440b87d75e4de6fdedcd => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:05.662741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.680083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05feb29-97ed-40ec-a424-ab9034ba5916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:05.680966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05feb29-97ed-40ec-a424-ab9034ba5916 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.681251 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05feb29-97ed-40ec-a424-ab9034ba5916 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.681529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05feb29-97ed-40ec-a424-ab9034ba5916 None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.682860 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05feb29-97ed-40ec-a424-ab9034ba5916 None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.684363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05feb29-97ed-40ec-a424-ab9034ba5916 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.686370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 215/436] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:05.687488 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35e93-5650-431b-8cd6-4ec4cad3e19a None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.687840 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35e93-5650-431b-8cd6-4ec4cad3e19a None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.688652 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f35e93-5650-431b-8cd6-4ec4cad3e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.694252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:05.709872 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-63f35e93-5650-431b-8cd6-4ec4cad3e19a None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:05.711140 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-63f35e93-5650-431b-8cd6-4ec4cad3e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:05.743472 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:05.794331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 216/437] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:05.795240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35e93-5650-431b-8cd6-4ec4cad3e19a None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.806791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1e77-f97e-4b8b-a1d3-f90957f72890 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:05.848861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27838972-5587-4074-b20d-72efd929650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:05.850056 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838972-5587-4074-b20d-72efd929650f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.850774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838972-5587-4074-b20d-72efd929650f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.851495 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27838972-5587-4074-b20d-72efd929650f None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.852758 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27838972-5587-4074-b20d-72efd929650f None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.854214 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27838972-5587-4074-b20d-72efd929650f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.856824 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 222/438] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:05.857525 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85211a-8b1a-40f3-96a9-bced50f4895a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.857815 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85211a-8b1a-40f3-96a9-bced50f4895a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.858102 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85211a-8b1a-40f3-96a9-bced50f4895a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.859436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 223/439] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:05.860222 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85211a-8b1a-40f3-96a9-bced50f4895a None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.923177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f35e93-5650-431b-8cd6-4ec4cad3e19a None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:05.957772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:05.959559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:05.960224 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:05.960505 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:05.960782 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:05.961704 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] RBAC: Adding query filter params (group.id=5f4b0ed5be7d494588bd49084a1ec095, role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=d5c2839cdfc7453089ac16e62f08a110) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:05.962048 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:05.963530 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:05.970102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 217/440] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/role_assignments?group.id=5f4b0ed5be7d494588bd49084a1ec095&scope.project.id=d5c2839cdfc7453089ac16e62f08a110&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:05.971075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:05.979083 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85211a-8b1a-40f3-96a9-bced50f4895a None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.000569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:06.024193 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ba1e6-3235-4139-a75b-9f0b1b332688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.025020 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba1e6-3235-4139-a75b-9f0b1b332688 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.025308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba1e6-3235-4139-a75b-9f0b1b332688 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.025588 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ba1e6-3235-4139-a75b-9f0b1b332688 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.039570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ba1e6-3235-4139-a75b-9f0b1b332688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-be8ba1e6-3235-4139-a75b-9f0b1b332688 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:06.048215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:06.049227 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 09:33:06.050017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:06.054751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 224/441] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:06.056230 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7188b-9127-41e7-87f5-a6595a7d7ebe None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.056527 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7188b-9127-41e7-87f5-a6595a7d7ebe None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.056813 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7188b-9127-41e7-87f5-a6595a7d7ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.081126 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-91b7188b-9127-41e7-87f5-a6595a7d7ebe None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:06.082686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-91b7188b-9127-41e7-87f5-a6595a7d7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:06.090866 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ef1a-3ed3-4def-afbc-77bf4e45946b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.129886 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a3c4-1201-46c3-8dc4-346a376aef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.130937 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a3c4-1201-46c3-8dc4-346a376aef18 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.131225 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a3c4-1201-46c3-8dc4-346a376aef18 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.131505 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a3c4-1201-46c3-8dc4-346a376aef18 None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.132769 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a3c4-1201-46c3-8dc4-346a376aef18 None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:06.134316 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a3c4-1201-46c3-8dc4-346a376aef18 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:06.140787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 218/442] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:05 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:06.140787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a3c4-1201-46c3-8dc4-346a376aef18 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:06.166678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 225/443] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:06.167032 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7188b-9127-41e7-87f5-a6595a7d7ebe None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:06.251535 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:06.253780 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:06.262365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a3c4-1201-46c3-8dc4-346a376aef18 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.291932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7188b-9127-41e7-87f5-a6595a7d7ebe None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.309267 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.309957 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.310356 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.310673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.311447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:06.311759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:06.313679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:06.326413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 219/444] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:06.326413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:06.339530 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.340319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.340710 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.341103 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.342054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] RBAC: Adding query filter params (group.id=5f4b0ed5be7d494588bd49084a1ec095, role.id=c96e5110ca5c4ed68198a5df1ce6d04f, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:06.342494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:06.344162 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:06.352659 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 226/445] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:33:06 2022] GET /identity/v3/role_assignments?group.id=5f4b0ed5be7d494588bd49084a1ec095&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=c96e5110ca5c4ed68198a5df1ce6d04f => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:06.353485 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:06.465114 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b33b20-5b46-4f94-921d-c826cef47973 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.489601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd3a1-b418-4c1a-80db-bd17486223a2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.509452 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b43e19-ca0d-4630-bc20-550396af7b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.510190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b43e19-ca0d-4630-bc20-550396af7b72 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.510499 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b43e19-ca0d-4630-bc20-550396af7b72 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.510808 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b43e19-ca0d-4630-bc20-550396af7b72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.524759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b43e19-ca0d-4630-bc20-550396af7b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-30b43e19-ca0d-4630-bc20-550396af7b72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:06.532871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:06.533821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:06.535323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 220/446] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:06.542290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b43e19-ca0d-4630-bc20-550396af7b72 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:06.550743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5d01-14fb-4472-804a-e4c261c4c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.551406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5d01-14fb-4472-804a-e4c261c4c48f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.551693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5d01-14fb-4472-804a-e4c261c4c48f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.551971 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5d01-14fb-4472-804a-e4c261c4c48f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.555112 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:06.565651 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:06.643485 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5d01-14fb-4472-804a-e4c261c4c48f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:06.644969 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5d01-14fb-4472-804a-e4c261c4c48f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:06.668253 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b43e19-ca0d-4630-bc20-550396af7b72 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.711600 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.712270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.712560 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.712844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.713635 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:06.713954 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:06.715378 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:06.726552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 221/447] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:06.731495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:06.762818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 227/448] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:06.768715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5d01-14fb-4472-804a-e4c261c4c48f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:06.807500 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:06.826354 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:06.848849 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724862f-61bb-4aec-aac9-a1f0ff2ad99d None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.876966 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5d01-14fb-4472-804a-e4c261c4c48f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:06.882698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bc57d-9130-447c-a1e4-ef0c45dc9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.883352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bc57d-9130-447c-a1e4-ef0c45dc9e95 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.883640 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bc57d-9130-447c-a1e4-ef0c45dc9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.883921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bc57d-9130-447c-a1e4-ef0c45dc9e95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.912738 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82f7f3-5345-4716-bb2f-23f94daa71b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:06.913601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82f7f3-5345-4716-bb2f-23f94daa71b2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:06.913886 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82f7f3-5345-4716-bb2f-23f94daa71b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:06.914164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82f7f3-5345-4716-bb2f-23f94daa71b2 None admin] PATH_INFO: `/v3/projects/688bf756f62c4e97a15b6887b5f90f2f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:06.915396 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82f7f3-5345-4716-bb2f-23f94daa71b2 None admin] RBAC: Authorizing `identity:get_project(project_id=688bf756f62c4e97a15b6887b5f90f2f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:06.916839 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82f7f3-5345-4716-bb2f-23f94daa71b2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:06.918558 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 228/449] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:06 2022] GET /identity/v3/projects/688bf756f62c4e97a15b6887b5f90f2f => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:06.925062 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82f7f3-5345-4716-bb2f-23f94daa71b2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:06.952880 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bc57d-9130-447c-a1e4-ef0c45dc9e95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:06.954389 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bc57d-9130-447c-a1e4-ef0c45dc9e95 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:07.023791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82f7f3-5345-4716-bb2f-23f94daa71b2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:07.025200 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:07.030968 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:07.055139 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 222/450] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:07.060757 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bc57d-9130-447c-a1e4-ef0c45dc9e95 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:07.061094 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519225e-79f9-40d2-a89c-e0989d8973d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:07.061967 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519225e-79f9-40d2-a89c-e0989d8973d8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:07.062256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519225e-79f9-40d2-a89c-e0989d8973d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:07.062567 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519225e-79f9-40d2-a89c-e0989d8973d8 None admin] PATH_INFO: `/v3/groups/5f4b0ed5be7d494588bd49084a1ec095` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:07.064060 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519225e-79f9-40d2-a89c-e0989d8973d8 None admin] RBAC: Authorizing `identity:get_group(group_id=5f4b0ed5be7d494588bd49084a1ec095)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:07.066053 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519225e-79f9-40d2-a89c-e0989d8973d8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:07.072801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 229/451] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:06 2022] GET /identity/v3/groups/5f4b0ed5be7d494588bd49084a1ec095 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:07.073733 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519225e-79f9-40d2-a89c-e0989d8973d8 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:07.160281 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bc57d-9130-447c-a1e4-ef0c45dc9e95 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:07.175695 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519225e-79f9-40d2-a89c-e0989d8973d8 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:07.194521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d2a5e-f616-4c16-9285-39e2ddc285b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:07.195380 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d2a5e-f616-4c16-9285-39e2ddc285b3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:07.195667 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d2a5e-f616-4c16-9285-39e2ddc285b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:07.195946 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d2a5e-f616-4c16-9285-39e2ddc285b3 None admin] PATH_INFO: `/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:07.197121 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d2a5e-f616-4c16-9285-39e2ddc285b3 None admin] RBAC: Authorizing `identity:get_project(project_id=81ad3fb6bc2540d4880f089b3fb44ef8)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:07.198594 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d2a5e-f616-4c16-9285-39e2ddc285b3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:07.200280 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 223/452] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Jul 25 09:33:07 2022] GET /identity/v3/projects/81ad3fb6bc2540d4880f089b3fb44ef8 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:07.205734 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d2a5e-f616-4c16-9285-39e2ddc285b3 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:07.209664 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:07.210320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:07.210641 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:07.210922 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:07.211748 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] RBAC: Adding query filter params (group.id=5f4b0ed5be7d494588bd49084a1ec095, role.id=fdcb4b876026440b87d75e4de6fdedcd, scope.project.id=688bf756f62c4e97a15b6887b5f90f2f) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:07.212064 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:07.216781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:07.222149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 230/453] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:33:07 2022] GET /identity/v3/role_assignments?group.id=5f4b0ed5be7d494588bd49084a1ec095&scope.project.id=688bf756f62c4e97a15b6887b5f90f2f&role.id=fdcb4b876026440b87d75e4de6fdedcd => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:07.254566 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:07.313583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d2a5e-f616-4c16-9285-39e2ddc285b3 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:07.351923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca040e5b-b079-4b41-bc83-e920ee17388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:07.352801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040e5b-b079-4b41-bc83-e920ee17388a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:07.353084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040e5b-b079-4b41-bc83-e920ee17388a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:07.353356 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040e5b-b079-4b41-bc83-e920ee17388a None admin] PATH_INFO: `/v3/groups/6de88f5ec7184de3985e0f73565c809b` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:07.354634 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca040e5b-b079-4b41-bc83-e920ee17388a None admin] RBAC: Authorizing `identity:get_group(group_id=6de88f5ec7184de3985e0f73565c809b)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:07.356116 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca040e5b-b079-4b41-bc83-e920ee17388a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:07.357785 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 224/454] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Jul 25 09:33:07 2022] GET /identity/v3/groups/6de88f5ec7184de3985e0f73565c809b => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:07.363864 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:07.398909 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:07.467758 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136a51-1652-477c-a9e7-c4631330f1ae None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:07.503071 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1acde4-c9bb-4792-ae3c-1968a226665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:07.503732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1acde4-c9bb-4792-ae3c-1968a226665b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:07.504028 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1acde4-c9bb-4792-ae3c-1968a226665b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:07.504331 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1acde4-c9bb-4792-ae3c-1968a226665b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:07.505169 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1acde4-c9bb-4792-ae3c-1968a226665b None admin] RBAC: Adding query filter params (group.id=6de88f5ec7184de3985e0f73565c809b, role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=81ad3fb6bc2540d4880f089b3fb44ef8) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:07.505489 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1acde4-c9bb-4792-ae3c-1968a226665b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:07.507084 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1acde4-c9bb-4792-ae3c-1968a226665b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:07.513456 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 231/455] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Jul 25 09:33:07 2022] GET /identity/v3/role_assignments?group.id=6de88f5ec7184de3985e0f73565c809b&scope.project.id=81ad3fb6bc2540d4880f089b3fb44ef8&role.id=bd8b88fae376413398183761500b2e1d => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:10.051899 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c2d4-11d3-47c6-8afe-213f62e21e5a None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.052453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c2d4-11d3-47c6-8afe-213f62e21e5a None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.052453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c2d4-11d3-47c6-8afe-213f62e21e5a None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.054227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 225/456] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:10.059671 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7d65-bad9-4ba6-b352-9ca9f5a33631 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.060540 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7d65-bad9-4ba6-b352-9ca9f5a33631 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.061057 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7d65-bad9-4ba6-b352-9ca9f5a33631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.082518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-3d5f7d65-bad9-4ba6-b352-9ca9f5a33631 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:10.084141 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-3d5f7d65-bad9-4ba6-b352-9ca9f5a33631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:10.157551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 232/457] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:10.183522 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c2d4-11d3-47c6-8afe-213f62e21e5a None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:10.283260 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fcdf3-6859-4212-87ac-05eb545ac14e None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.283899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fcdf3-6859-4212-87ac-05eb545ac14e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.284382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fcdf3-6859-4212-87ac-05eb545ac14e None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.286002 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 233/458] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:10.295645 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562aec2-0c18-4ce4-b0d1-aad1c70b9e27 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.296230 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562aec2-0c18-4ce4-b0d1-aad1c70b9e27 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.296797 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562aec2-0c18-4ce4-b0d1-aad1c70b9e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.304825 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c2d4-11d3-47c6-8afe-213f62e21e5a None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:10.317828 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-f562aec2-0c18-4ce4-b0d1-aad1c70b9e27 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:10.319423 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-f562aec2-0c18-4ce4-b0d1-aad1c70b9e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:10.320935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:10.346493 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1242c9-5987-4411-b790-dce68b27a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:10.347285 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1242c9-5987-4411-b790-dce68b27a747 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.347569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1242c9-5987-4411-b790-dce68b27a747 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.347845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1242c9-5987-4411-b790-dce68b27a747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.362059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:10.362339 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1242c9-5987-4411-b790-dce68b27a747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:10.364069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1242c9-5987-4411-b790-dce68b27a747 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-7e1242c9-5987-4411-b790-dce68b27a747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:10.387417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:10.397001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 226/459] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46939b03-dd06-4ba5-b4fa-8903d2d94ef6 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46939b03-dd06-4ba5-b4fa-8903d2d94ef6 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46939b03-dd06-4ba5-b4fa-8903d2d94ef6 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.398082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 227/460] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:10.398733 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46939b03-dd06-4ba5-b4fa-8903d2d94ef6 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:10.405765 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 234/461] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:33:10.407519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610c7e-db37-45c5-b79a-c597f8bea912 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.408017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610c7e-db37-45c5-b79a-c597f8bea912 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.408640 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2610c7e-db37-45c5-b79a-c597f8bea912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.431420 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-b2610c7e-db37-45c5-b79a-c597f8bea912 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:10.432599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-b2610c7e-db37-45c5-b79a-c597f8bea912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:10.504272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 235/462] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:10.505212 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2610c7e-db37-45c5-b79a-c597f8bea912 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:10.524934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46939b03-dd06-4ba5-b4fa-8903d2d94ef6 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:10.564906 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:10.565491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.565781 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.566062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.567243 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:10.567569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:10.568957 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:10.593128 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 228/463] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:10.593128 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:10.608163 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:10.619969 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:10.620975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2610c7e-db37-45c5-b79a-c597f8bea912 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:10.659253 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:10.660047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.660328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.660603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.671158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:10.672923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:10.691000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:10.691890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:10.692970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:10.692970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:10.692970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:10.692970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:10.692970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 236/464] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:10.693460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:10.700843 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee683b-53a5-4b7d-a2ed-e8c1490865bb None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:10.735780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862672d-3af0-45cd-8d70-0ab021402465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:10.736575 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862672d-3af0-45cd-8d70-0ab021402465 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.736895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862672d-3af0-45cd-8d70-0ab021402465 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.737175 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862672d-3af0-45cd-8d70-0ab021402465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.747045 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862672d-3af0-45cd-8d70-0ab021402465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:10.748531 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862672d-3af0-45cd-8d70-0ab021402465 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-e862672d-3af0-45cd-8d70-0ab021402465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:10.767039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:10.767922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:10.768798 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:10.768798 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:10.768798 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:10.768798 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:10.769011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 229/465] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:10.770643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd4103-6ff8-49dd-a7a6-856af24afae2 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.770940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd4103-6ff8-49dd-a7a6-856af24afae2 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.771224 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd4103-6ff8-49dd-a7a6-856af24afae2 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.773320 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 230/466] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:10.774034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd4103-6ff8-49dd-a7a6-856af24afae2 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:10.795488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55a99-b8b2-452a-a652-b6eabf3a6e79 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:10.830258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a4baf-b582-47f8-bfca-5f04f068dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:10.830884 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4baf-b582-47f8-bfca-5f04f068dd4f None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.831415 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4baf-b582-47f8-bfca-5f04f068dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.831702 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4baf-b582-47f8-bfca-5f04f068dd4f None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.832403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a4baf-b582-47f8-bfca-5f04f068dd4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:10.833833 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a4baf-b582-47f8-bfca-5f04f068dd4f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:10.844609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:10.853179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:10.876708 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd4103-6ff8-49dd-a7a6-856af24afae2 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:10.909474 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:10.910209 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.910530 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.910820 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.911582 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:10.911892 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:10.913276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:10.925041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 231/467] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:10.925838 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:10.974496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 237/468] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:33:10 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:33:10.974496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86742728-1c08-43ec-84fc-9ed930a0e9a6 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:10.974496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86742728-1c08-43ec-84fc-9ed930a0e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:10.974496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86742728-1c08-43ec-84fc-9ed930a0e9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:10.985072 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-86742728-1c08-43ec-84fc-9ed930a0e9a6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:10.986346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-86742728-1c08-43ec-84fc-9ed930a0e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:11.037388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eecf9-8e2b-4b65-bf7a-641bfcfda3e8 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:11.061949 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 238/469] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:11.063464 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86742728-1c08-43ec-84fc-9ed930a0e9a6 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:11.100248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:11.100248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:11.100248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:11.100248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:11.101028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:11.101028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:11.101028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:11.101028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:11.107917 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 232/470] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:11.110534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:11.203976 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86742728-1c08-43ec-84fc-9ed930a0e9a6 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:11.225717 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522d1a7-a5f1-4c27-a4fa-c2a08e76deb2 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:11.235117 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:11.246061 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f564a6a-4699-456a-8472-b6786c1338a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:11.246782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f564a6a-4699-456a-8472-b6786c1338a4 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:11.247073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f564a6a-4699-456a-8472-b6786c1338a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:11.247446 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f564a6a-4699-456a-8472-b6786c1338a4 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:11.248599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f564a6a-4699-456a-8472-b6786c1338a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:11.250745 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f564a6a-4699-456a-8472-b6786c1338a4 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:11.263104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:11.264077 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:11.264370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:11.264651 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:11.278035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:11.279560 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:11.297952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:11.299414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:11.300475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:11.300475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:11.300475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:11.300475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:11.300895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 233/471] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:11.301706 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:11.371164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:11.410702 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9939145-a961-498b-b9ab-dbc9c1b8241f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:11.445014 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3caac-81dd-4d6f-ae8a-aeb3745eccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:11.445688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3caac-81dd-4d6f-ae8a-aeb3745eccbd None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:11.445976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3caac-81dd-4d6f-ae8a-aeb3745eccbd None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:11.446255 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3caac-81dd-4d6f-ae8a-aeb3745eccbd None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:11.446995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3caac-81dd-4d6f-ae8a-aeb3745eccbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:11.448517 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3caac-81dd-4d6f-ae8a-aeb3745eccbd None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:11.483329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 239/472] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:33:11 2022] POST /identity/v3/users => generated 248 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:33:11.484470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f564a6a-4699-456a-8472-b6786c1338a4 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:11.597600 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 234/473] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:33:11 2022] POST /identity/v3/users => generated 248 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:33:11.625127 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f564a6a-4699-456a-8472-b6786c1338a4 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:11.669827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b91a88-4cf4-453d-a279-df43c73c8a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:11.670558 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91a88-4cf4-453d-a279-df43c73c8a99 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:11.670857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91a88-4cf4-453d-a279-df43c73c8a99 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:11.671141 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91a88-4cf4-453d-a279-df43c73c8a99 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:11.671891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b91a88-4cf4-453d-a279-df43c73c8a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:11.672340 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b91a88-4cf4-453d-a279-df43c73c8a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:11.674292 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b91a88-4cf4-453d-a279-df43c73c8a99 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:11.689029 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 240/474] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:11.694818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3caac-81dd-4d6f-ae8a-aeb3745eccbd None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:11.818962 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3caac-81dd-4d6f-ae8a-aeb3745eccbd None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:11.822108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:11.857035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c8e6e-1e60-46b8-bcde-a4a9c42992ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:11.857713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8e6e-1e60-46b8-bcde-a4a9c42992ea None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:11.858000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8e6e-1e60-46b8-bcde-a4a9c42992ea None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:11.858278 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8e6e-1e60-46b8-bcde-a4a9c42992ea None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:11.859091 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c8e6e-1e60-46b8-bcde-a4a9c42992ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:11.861388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c8e6e-1e60-46b8-bcde-a4a9c42992ea None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:11.981160 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 235/475] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:33:11 2022] POST /identity/v3/users => generated 249 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:33:13.339179 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfab0c-71d7-4ee0-bc53-cf491223d5d9 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:13.339661 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfab0c-71d7-4ee0-bc53-cf491223d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:13.339970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfab0c-71d7-4ee0-bc53-cf491223d5d9 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:13.341729 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 241/476] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:13.347745 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fabfb7-d18b-48bf-a48b-603ee97c5385 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:13.348185 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fabfb7-d18b-48bf-a48b-603ee97c5385 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:13.348507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fabfb7-d18b-48bf-a48b-603ee97c5385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:13.367980 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-66fabfb7-d18b-48bf-a48b-603ee97c5385 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:13.369210 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-66fabfb7-d18b-48bf-a48b-603ee97c5385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:13.443214 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 236/477] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:13.467745 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfab0c-71d7-4ee0-bc53-cf491223d5d9 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:13.518351 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:13.581746 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfab0c-71d7-4ee0-bc53-cf491223d5d9 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:13.621364 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36201-524f-4f09-9e96-599f4ab8d816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:13.622090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36201-524f-4f09-9e96-599f4ab8d816 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:13.622378 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36201-524f-4f09-9e96-599f4ab8d816 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:13.622687 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36201-524f-4f09-9e96-599f4ab8d816 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:13.634486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a36201-524f-4f09-9e96-599f4ab8d816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-b0a36201-524f-4f09-9e96-599f4ab8d816 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:13.643399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:13.644336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:13.645191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 242/478] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:13.652182 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fabfb7-d18b-48bf-a48b-603ee97c5385 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:13.750308 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:13.762114 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fabfb7-d18b-48bf-a48b-603ee97c5385 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:13.802725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168843e-24fc-4cff-bf2c-fe24341fae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:13.803753 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168843e-24fc-4cff-bf2c-fe24341fae30 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:13.804259 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168843e-24fc-4cff-bf2c-fe24341fae30 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:13.804754 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168843e-24fc-4cff-bf2c-fe24341fae30 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:13.805716 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168843e-24fc-4cff-bf2c-fe24341fae30 None admin] RBAC: Adding query filter params (name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:13.806232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168843e-24fc-4cff-bf2c-fe24341fae30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:13.807867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168843e-24fc-4cff-bf2c-fe24341fae30 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:13.817082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 237/479] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:13.822916 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36201-524f-4f09-9e96-599f4ab8d816 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:13.940379 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36201-524f-4f09-9e96-599f4ab8d816 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:13.942309 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef08e02-7c18-4d86-b82b-7a7871d91dbf None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:13.942836 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:13.943065 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef08e02-7c18-4d86-b82b-7a7871d91dbf None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:13.943535 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef08e02-7c18-4d86-b82b-7a7871d91dbf None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:13.945347 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 238/480] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:13.950862 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ffa2d-bfd6-4d62-8fa6-5438bbaa2f61 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:13.951421 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ffa2d-bfd6-4d62-8fa6-5438bbaa2f61 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:13.951921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ffa2d-bfd6-4d62-8fa6-5438bbaa2f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:13.971879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-d39ffa2d-bfd6-4d62-8fa6-5438bbaa2f61 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:13.973844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-d39ffa2d-bfd6-4d62-8fa6-5438bbaa2f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:13.975604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:13.976402 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:13.976680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:13.976959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:13.987933 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:13.989404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:14.007134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:14.008027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:14.008858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:14.008858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:14.008858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:14.008858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:14.008858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 243/481] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:14.016740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.062995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 239/482] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:33:14.064961 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef45ab2-b4b9-4569-a245-05bc5d371524 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.065256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef45ab2-b4b9-4569-a245-05bc5d371524 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.065542 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef45ab2-b4b9-4569-a245-05bc5d371524 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.066855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 240/483] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:14.077065 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025f57-6684-42ba-8769-1bed3ffea1a5 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.077532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025f57-6684-42ba-8769-1bed3ffea1a5 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.078267 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025f57-6684-42ba-8769-1bed3ffea1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.099090 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-dc025f57-6684-42ba-8769-1bed3ffea1a5 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:14.100271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-dc025f57-6684-42ba-8769-1bed3ffea1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:14.139813 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec204c-1434-4f2a-a44f-c3af0a053696 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.176867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 241/484] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:33:14.178715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.179404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.179692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.179971 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.180772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:14.181086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:14.182599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:14.187492 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025f57-6684-42ba-8769-1bed3ffea1a5 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.205778 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 244/485] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:14.206696 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.214353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:14.226371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:14.314504 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c07196-9580-4e50-80df-38ab995a3cf5 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.318304 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025f57-6684-42ba-8769-1bed3ffea1a5 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.350551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415da3e-2128-4abe-b55d-61927c4ec7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.351347 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415da3e-2128-4abe-b55d-61927c4ec7b2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.351637 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415da3e-2128-4abe-b55d-61927c4ec7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.351916 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415da3e-2128-4abe-b55d-61927c4ec7b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.358952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23522a-3b9e-4d81-99fb-769a691f73b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.359775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23522a-3b9e-4d81-99fb-769a691f73b0 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.360062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23522a-3b9e-4d81-99fb-769a691f73b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.360342 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23522a-3b9e-4d81-99fb-769a691f73b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.362421 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415da3e-2128-4abe-b55d-61927c4ec7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1415da3e-2128-4abe-b55d-61927c4ec7b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:14.370124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:14.371080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:14.371866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:14.372471 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23522a-3b9e-4d81-99fb-769a691f73b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:14.372551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 245/486] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:14.372551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415da3e-2128-4abe-b55d-61927c4ec7b2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-fd23522a-3b9e-4d81-99fb-769a691f73b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:14.378778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:14.379935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:14.380922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 242/487] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:14.382605 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec3486-fc67-4999-a50a-974152164eb1 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.382605 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec3486-fc67-4999-a50a-974152164eb1 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.382605 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec3486-fc67-4999-a50a-974152164eb1 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.387358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 243/488] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:14.387358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec3486-fc67-4999-a50a-974152164eb1 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.451456 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:14.455902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:14.476717 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415da3e-2128-4abe-b55d-61927c4ec7b2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.487053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec3486-fc67-4999-a50a-974152164eb1 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.511256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4df68-9ac2-40f2-a406-1cc477df5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.512051 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4df68-9ac2-40f2-a406-1cc477df5fff None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.512340 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4df68-9ac2-40f2-a406-1cc477df5fff None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.512622 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4df68-9ac2-40f2-a406-1cc477df5fff None admin] PATH_INFO: `/v3/users/nova` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.520793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4df68-9ac2-40f2-a406-1cc477df5fff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:14.521496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.522164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.522260 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4df68-9ac2-40f2-a406-1cc477df5fff None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:14.522453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.522768 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.523551 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:14.523868 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:14.525261 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:14.533276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 244/489] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:14.534062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-bff4df68-9ac2-40f2-a406-1cc477df5fff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:14.537705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:14.538652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:14.539557 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 246/490] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:14.540143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331afc3-b827-4f2c-aa8b-9a800e1795ce None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.540425 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331afc3-b827-4f2c-aa8b-9a800e1795ce None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.540832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331afc3-b827-4f2c-aa8b-9a800e1795ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.558581 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-a331afc3-b827-4f2c-aa8b-9a800e1795ce None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:14.559779 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-a331afc3-b827-4f2c-aa8b-9a800e1795ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:14.628746 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 247/491] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:14.629578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331afc3-b827-4f2c-aa8b-9a800e1795ce None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.644665 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d0c2-5afb-47be-9be7-328cc37c42c5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.678973 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.679639 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.679920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.680195 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.680935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] RBAC: Adding query filter params (name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:14.681240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:14.682632 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:14.683934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:14.691671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 245/492] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:14.692455 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.699470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:14.737868 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331afc3-b827-4f2c-aa8b-9a800e1795ce None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.773309 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.774101 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.774385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.774692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.784920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:14.786296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:14.791283 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc386dd-3f55-406f-9120-ec186e233997 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:14.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:14.805468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:14.806304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:14.806304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:14.806304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:14.806304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:14.806304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 248/493] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:14.806603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.828698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.829361 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.829643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.829919 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.830807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:14.831377 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:14.832816 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:14.868396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 246/494] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:14.869217 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.909207 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9048-41fb-4d49-9124-0c4eefc4b3ad None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:14.926062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:14.927244 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:14.945606 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f223310-2a93-483e-936d-350b88a0d3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:14.946400 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f223310-2a93-483e-936d-350b88a0d3a1 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:14.947603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f223310-2a93-483e-936d-350b88a0d3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:14.947603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f223310-2a93-483e-936d-350b88a0d3a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:14.958353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f223310-2a93-483e-936d-350b88a0d3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-8f223310-2a93-483e-936d-350b88a0d3a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:14.966239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:14.967246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:14.968031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 249/495] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:14.968670 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f223310-2a93-483e-936d-350b88a0d3a1 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:14.976065 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38337dc8-78ec-4d34-af36-6ee378306ba9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.011644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.012375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.012660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.012941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.023706 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.025207 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:15.042590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:15.043518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:15.044393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:15.044393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:15.044393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:15.044393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:15.044393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 247/496] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:15.045086 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.073538 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f223310-2a93-483e-936d-350b88a0d3a1 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.107835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.108504 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.108792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.109069 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.110385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:15.110766 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.112225 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.124172 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 250/497] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:15.124984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.147630 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb089-8754-42be-b942-6647e1875a2f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.154537 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:15.160027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:15.181301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471138a-30c0-4314-b7f9-692206307bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.181994 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471138a-30c0-4314-b7f9-692206307bb0 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.182379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471138a-30c0-4314-b7f9-692206307bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.182796 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471138a-30c0-4314-b7f9-692206307bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.227747 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f19f-bebb-4f92-9e3c-db94a887c6af None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.251914 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471138a-30c0-4314-b7f9-692206307bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.253411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471138a-30c0-4314-b7f9-692206307bb0 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.261546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.262284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.262543 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.262821 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.263558 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:15.263861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.265202 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.276060 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 251/498] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:15.276889 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.372608 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 248/499] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:15.373554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471138a-30c0-4314-b7f9-692206307bb0 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.381945 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:15.389842 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:15.393684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156817c4-e3fd-4209-8f71-9b21834710b3 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.429173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.430087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.430372 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.430684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.431401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:15.431712 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.433089 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.444613 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 252/500] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:15.447964 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.473840 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471138a-30c0-4314-b7f9-692206307bb0 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.510239 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.511055 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.511334 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.511603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.518562 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.520019 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:15.536075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:15.537136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 09:33:15.538051 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:15.541938 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 249/501] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:15.542663 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.549422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba68e-9979-4f00-99a3-640c035d6b2a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.585185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.585972 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.586461 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.586586 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.597652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.599146 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.609297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:15.617299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:15.618284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:15.627201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:15.627201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:15.627201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:15.627201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:15.627201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 253/502] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:15.627201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.634691 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:15.645398 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba668-15c2-4f94-8c85-379d524f2142 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.680615 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.681408 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.681697 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.681978 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.691957 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.693444 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:15.711603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:15.712638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:15.713684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:15.713684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:15.713684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:15.713684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:15.713684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 250/503] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:15.713684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.727134 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4ff2-61cb-4f07-b3be-3b58bdd0e3de None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.761739 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.762562 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.762852 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.763130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.770758 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.772490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:15.787673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:15.788680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 254/504] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:15.789665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.820357 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299b505-e2e1-41e0-8402-66234772393a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.838092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:15.854930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.855596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.855879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.856158 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.856993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:15.857304 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.858770 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.859404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:15.878646 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 251/505] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:15.884178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.891771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380fec9-1896-41a5-818a-04de061c4560 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:15.926516 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:15.927180 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:15.927472 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:15.927762 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:15.928480 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:15.928834 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:15.930216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:15.942104 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 255/506] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:15.942923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:15.983616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefe7a0-ba7c-49f6-9e9a-1f3a397c2c07 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.016572 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.017231 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.017516 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.017791 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.018534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:16.018846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.020215 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.031944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 252/507] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:16.032691 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.045259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124d3f7-511e-4d74-bb01-2724fb5ef203 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.067036 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.073559 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.079289 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.079952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.080240 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.080517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.081605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:16.081916 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.083371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.120170 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 256/508] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Jul 25 09:33:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:16.120997 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.131706 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d53f9d-a555-4022-875d-191ff0be12a7 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.165258 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8667a-9b1f-4dfc-9a6e-e2d062eacad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.165906 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8667a-9b1f-4dfc-9a6e-e2d062eacad3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.166196 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8667a-9b1f-4dfc-9a6e-e2d062eacad3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.166496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8667a-9b1f-4dfc-9a6e-e2d062eacad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.224235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185564fb-3510-44bf-beac-1788f70af536 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.233639 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8667a-9b1f-4dfc-9a6e-e2d062eacad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.236044 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8667a-9b1f-4dfc-9a6e-e2d062eacad3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.259178 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.259985 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.260272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.260551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.267684 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.269138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.269638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:16.288568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:16.289698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:16.290639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 257/509] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:16.291211 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.342521 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.343564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 253/510] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:16.345128 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8667a-9b1f-4dfc-9a6e-e2d062eacad3 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.398477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c94a92-cb1f-462f-bc6a-207ee9caa6c2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.433220 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.434006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.434291 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.434605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.441486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.442996 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.446645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8667a-9b1f-4dfc-9a6e-e2d062eacad3 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:16.458893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:16.459760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:16.460629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 258/511] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:16.461091 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.484164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f71d6e-fe76-46f8-8880-d7c5b80b50d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.484884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f71d6e-fe76-46f8-8880-d7c5b80b50d9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.485169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f71d6e-fe76-46f8-8880-d7c5b80b50d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.492882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f71d6e-fe76-46f8-8880-d7c5b80b50d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.492882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.551507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f71d6e-fe76-46f8-8880-d7c5b80b50d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.552918 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f71d6e-fe76-46f8-8880-d7c5b80b50d9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.562677 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cfec8-6879-4962-a2ef-fb97a1b54019 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.571799 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.601144 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.601822 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.602112 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.603386 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.603386 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:16.603742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.605027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.621908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 259/512] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:16.622740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.654904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 254/513] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:16.656174 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f71d6e-fe76-46f8-8880-d7c5b80b50d9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.690367 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.727863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d3985-2adc-458a-852c-597e0ad63ca0 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.755783 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f71d6e-fe76-46f8-8880-d7c5b80b50d9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.761681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.762497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.762798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.763085 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.773935 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.775441 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.791573 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.792235 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.792523 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.792799 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:16.793245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:16.794059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:16.794956 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:16.794956 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:16.794956 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:16.794956 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:16.795159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:16.795159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.795275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 260/514] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:16.795275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.795400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.813894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 255/515] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:16.814702 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:16.829045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.909959 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:16.911432 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d788cd-2399-4e5c-bb68-dda1f46125b9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.915760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc666dc6-caf2-4cb5-87e6-71e93fc71a27 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:16.945246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cc518-c1c9-46e3-b235-85aaa6d65d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.945895 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc518-c1c9-46e3-b235-85aaa6d65d68 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.946180 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc518-c1c9-46e3-b235-85aaa6d65d68 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.946459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cc518-c1c9-46e3-b235-85aaa6d65d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.950525 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:16.951316 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:16.951598 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:16.951875 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:16.962189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:16.963759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:16.981411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:16.982352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:16.983368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:16.983368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:16.983368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:16.983368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:16.983368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 256/516] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:16.983667 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.018531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cc518-c1c9-46e3-b235-85aaa6d65d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.019998 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cc518-c1c9-46e3-b235-85aaa6d65d68 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.038359 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:17.082631 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c379f-c64f-47fa-b78d-e9f37a2d472f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.117232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.117886 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.118178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.118459 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.119066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 261/517] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:17.119255 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:17.119528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.119890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cc518-c1c9-46e3-b235-85aaa6d65d68 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.120925 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.132545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 257/518] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:17.133575 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.148223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:17.220779 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cc518-c1c9-46e3-b235-85aaa6d65d68 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.238038 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:17.239069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9e5e-ad99-448a-816f-1dab4cd42779 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.254362 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.255049 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.255338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.255657 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.256486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=3d3ad9c9521e42f783693c1c4b20cadc) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:17.256800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.258286 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.263669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 262/519] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/role_assignments?user.id=3d3ad9c9521e42f783693c1c4b20cadc&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:17.264513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.284937 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.285784 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.286163 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.286584 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.287415 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:17.287803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.289370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.309967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 258/520] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:17.309967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.385775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:17.391297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6eb24-a9a0-4e96-9f33-96f0804c33c5 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.421385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce68f1d-4847-41eb-9071-5a5deafa49b2 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.437832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.439196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.439539 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.439818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.453013 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.454567 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.460615 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.461412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.461692 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.461970 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.470147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.471867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:17.475607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:17.476444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:17.477276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:17.477276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:17.477276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:17.477276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:17.479177 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 263/521] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:17.480132 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:17.489147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:17.490149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:17.491108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 259/522] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:17.491573 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.522810 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:17.595686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f7cc-40f5-4cae-a27f-bd490351acad None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.600856 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6384d3a-95b3-4738-b16c-74c8afb67c2b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.629428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:17.633889 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.634896 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.635339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.637544 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.637652 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.638328 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.638646 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.638927 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.639652 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:17.639958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.641584 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.644274 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.645923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.654374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 260/523] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:17.655223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:17.662095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:17.663063 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:17.664128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:17.664128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:17.664128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:17.664128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:17.664128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:17.664128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:17.664128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:17.664128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:17.666179 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 264/524] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:17.667149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.771216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:17.776199 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214fb29-bdad-4291-8936-68ad283db6dd None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.777865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e38af-166c-412a-93c2-1f893e53f9e1 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.811394 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.812060 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.812347 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.812728 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.814411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:17.814758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.816198 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.816756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.817840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.818266 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.818831 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.825925 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.827403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.833579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 261/525] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:17.833579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:17.847403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:17.848382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:17.849219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 265/526] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:17.850250 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.887103 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:17.944085 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6b5f8-62f4-4836-aa13-2cf7a064d3cd None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.954757 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04893b-6358-4133-bc01-4d161c0ce4dd None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:17.979726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.980396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.980685 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.980958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.981776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:17.982082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:17.983587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:17.995434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:17.996318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:17.996510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 262/527] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:17.996943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:17.997306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:17.997561 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:17.998655 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=362c7977a3564cc1a9c0ff0f0dcc6df6) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:17.998972 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:18.001137 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:18.007462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 266/528] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/role_assignments?user.id=362c7977a3564cc1a9c0ff0f0dcc6df6&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:18.008525 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:18.041672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:18.130383 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e855a-bac5-4f9d-a0b3-59d1d83e09b4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:18.143091 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:18.164635 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf1d0-d9fa-4c46-a404-3444b671e8ca None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:18.170364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:18.171157 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:18.171518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:18.171864 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:18.173313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:18.173733 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:18.175772 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:18.190080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 263/529] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:18.197767 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:18.213864 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c1d31-cc5f-43f1-97ef-84e6d374ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:18.214074 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1d31-cc5f-43f1-97ef-84e6d374ddb0 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:18.214321 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1d31-cc5f-43f1-97ef-84e6d374ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:18.214649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1d31-cc5f-43f1-97ef-84e6d374ddb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:18.215484 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c1d31-cc5f-43f1-97ef-84e6d374ddb0 None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=1a17097c198d491198553e03fd8e8327) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:18.215818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c1d31-cc5f-43f1-97ef-84e6d374ddb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:18.217238 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c1d31-cc5f-43f1-97ef-84e6d374ddb0 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:18.230513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 267/530] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:18 2022] GET /identity/v3/role_assignments?user.id=1a17097c198d491198553e03fd8e8327&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:18.331951 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3ee88-cef5-4823-ad9a-6abc525c8801 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:18.373406 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3affac2-4983-45fc-9734-9543cb60709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:18.374130 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affac2-4983-45fc-9734-9543cb60709b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:18.374422 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affac2-4983-45fc-9734-9543cb60709b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:18.374796 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affac2-4983-45fc-9734-9543cb60709b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:18.375740 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3affac2-4983-45fc-9734-9543cb60709b None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=3969b99ab3b9410388d56dda5a4e15e0) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:18.376068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3affac2-4983-45fc-9734-9543cb60709b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:18.377598 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3affac2-4983-45fc-9734-9543cb60709b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:18.385011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 264/531] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:18 2022] GET /identity/v3/role_assignments?user.id=3969b99ab3b9410388d56dda5a4e15e0&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:19.534324 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c449b-c141-48f3-8ecf-a8e4d41501f8 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:19.534870 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c449b-c141-48f3-8ecf-a8e4d41501f8 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:19.534945 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c449b-c141-48f3-8ecf-a8e4d41501f8 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:19.536411 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 268/532] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:19.542341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3f2e-2f38-4182-a31d-07ea44f40265 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:19.543354 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3f2e-2f38-4182-a31d-07ea44f40265 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:19.543843 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3f2e-2f38-4182-a31d-07ea44f40265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:19.563027 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-808d3f2e-2f38-4182-a31d-07ea44f40265 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:19.564609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-808d3f2e-2f38-4182-a31d-07ea44f40265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:19.593447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:19.636970 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 265/533] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:33:19.661501 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c449b-c141-48f3-8ecf-a8e4d41501f8 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:19.749297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:19.768958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c449b-c141-48f3-8ecf-a8e4d41501f8 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:19.805617 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1ede7-0cef-4ddb-b515-53b0e48033c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:19.806424 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ede7-0cef-4ddb-b515-53b0e48033c0 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:19.806743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ede7-0cef-4ddb-b515-53b0e48033c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:19.807024 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1ede7-0cef-4ddb-b515-53b0e48033c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:19.818224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1ede7-0cef-4ddb-b515-53b0e48033c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-87f1ede7-0cef-4ddb-b515-53b0e48033c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:19.825993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:19.827095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:19.828044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 269/534] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:19.834246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3f2e-2f38-4182-a31d-07ea44f40265 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:19.937869 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3f2e-2f38-4182-a31d-07ea44f40265 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:19.973949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:19.974665 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:19.975095 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:19.975380 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:19.976144 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] RBAC: Adding query filter params (name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:19.976457 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:19.977843 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:19.987518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 266/535] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:19.993102 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1ede7-0cef-4ddb-b515-53b0e48033c0 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:20.098960 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1ede7-0cef-4ddb-b515-53b0e48033c0 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:20.134320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:20.135147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.135439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.135725 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.147857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:20.149339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:20.151392 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:20.168399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:20.174434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:20.175327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:20.175327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:20.175327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:20.175327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:20.175327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 270/536] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:20.175918 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:20.206997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:20.289953 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87864f-e6c9-47d5-8d03-f276a4181664 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:20.326688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a8506-2fdd-44a1-9e24-3e8a349068b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:20.327695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8506-2fdd-44a1-9e24-3e8a349068b8 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.328197 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8506-2fdd-44a1-9e24-3e8a349068b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.328677 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8506-2fdd-44a1-9e24-3e8a349068b8 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.329711 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a8506-2fdd-44a1-9e24-3e8a349068b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:20.330204 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a8506-2fdd-44a1-9e24-3e8a349068b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:20.332053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a8506-2fdd-44a1-9e24-3e8a349068b8 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:20.345089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 267/537] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:20.350664 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:20.352110 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515ba9-060c-4b53-a628-12f4060ec050 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.352410 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515ba9-060c-4b53-a628-12f4060ec050 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.352753 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515ba9-060c-4b53-a628-12f4060ec050 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.354219 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 268/538] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:20.363868 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c424c6-2df1-47ae-9c96-6824443c1de2 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.364858 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c424c6-2df1-47ae-9c96-6824443c1de2 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.365331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c424c6-2df1-47ae-9c96-6824443c1de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.391061 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-b0c424c6-2df1-47ae-9c96-6824443c1de2 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:20.392729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-b0c424c6-2df1-47ae-9c96-6824443c1de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:20.467166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54a90-5e09-4922-9f2d-476c81e3ac27 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:20.498567 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 269/539] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:20.512691 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c424c6-2df1-47ae-9c96-6824443c1de2 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:20.520493 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841adcf-6942-4050-993a-44c79d6d3bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:20.521577 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841adcf-6942-4050-993a-44c79d6d3bf6 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.522092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841adcf-6942-4050-993a-44c79d6d3bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.523033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841adcf-6942-4050-993a-44c79d6d3bf6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.529874 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:20.535496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841adcf-6942-4050-993a-44c79d6d3bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:20.538762 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841adcf-6942-4050-993a-44c79d6d3bf6 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-e841adcf-6942-4050-993a-44c79d6d3bf6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:20.558511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:20.559679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:20.560626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:20.563501 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 271/540] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Jul 25 09:33:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:20.565201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc700b50-eee2-4059-beed-64160bbc5cd4 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.565498 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc700b50-eee2-4059-beed-64160bbc5cd4 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.566021 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc700b50-eee2-4059-beed-64160bbc5cd4 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.567401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 272/541] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:20.572490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc700b50-eee2-4059-beed-64160bbc5cd4 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:20.633120 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:20.633650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c424c6-2df1-47ae-9c96-6824443c1de2 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:20.670092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366009e3-d8d3-4159-9862-f663819b37a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:20.670913 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366009e3-d8d3-4159-9862-f663819b37a9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.671198 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366009e3-d8d3-4159-9862-f663819b37a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.671474 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366009e3-d8d3-4159-9862-f663819b37a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.682563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366009e3-d8d3-4159-9862-f663819b37a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:20.685502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc700b50-eee2-4059-beed-64160bbc5cd4 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-366009e3-d8d3-4159-9862-f663819b37a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:20.690478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:20.691370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:20.692186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 270/542] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:20.696154 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31779d7-66f1-4b9d-9028-eaadce3a59fc None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.696702 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31779d7-66f1-4b9d-9028-eaadce3a59fc None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.697014 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31779d7-66f1-4b9d-9028-eaadce3a59fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.719460 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-d31779d7-66f1-4b9d-9028-eaadce3a59fc None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:20.720590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-d31779d7-66f1-4b9d-9028-eaadce3a59fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:20.722772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:20.723450 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.723741 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.724019 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.724856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:20.725169 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:20.726623 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:20.744468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 273/543] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Jul 25 09:33:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:20.745273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:20.788682 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 271/544] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:20.790272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb530-6962-4ae8-aa2b-b16241586328 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.790588 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb530-6962-4ae8-aa2b-b16241586328 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.790878 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb530-6962-4ae8-aa2b-b16241586328 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.792400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 272/545] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:20.793111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdb530-6962-4ae8-aa2b-b16241586328 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:20.799059 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:20.852432 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5040d5-13c6-42fa-9c42-7e21e16de37b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:20.865471 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:20.886421 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32d20c-2ba2-4a68-8ec0-2c82d2638b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:20.887147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d20c-2ba2-4a68-8ec0-2c82d2638b0e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.887491 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d20c-2ba2-4a68-8ec0-2c82d2638b0e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.887771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d20c-2ba2-4a68-8ec0-2c82d2638b0e None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.888516 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32d20c-2ba2-4a68-8ec0-2c82d2638b0e None admin] RBAC: Adding query filter params (name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:20.888827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32d20c-2ba2-4a68-8ec0-2c82d2638b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:20.890219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32d20c-2ba2-4a68-8ec0-2c82d2638b0e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:20.899402 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdb530-6962-4ae8-aa2b-b16241586328 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:20.899537 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 274/546] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:20.900637 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ed1e-efb8-4c96-9855-73599672e699 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.900935 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ed1e-efb8-4c96-9855-73599672e699 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.901226 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ed1e-efb8-4c96-9855-73599672e699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.919359 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-2c27ed1e-efb8-4c96-9855-73599672e699 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:20.920558 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-2c27ed1e-efb8-4c96-9855-73599672e699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:20.934737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:20.935530 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:20.935817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:20.936096 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:20.946607 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:20.948077 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:20.966362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:20.967229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:20.968265 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:20.968265 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:20.968265 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:20.968265 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:20.968265 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 273/547] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:20.968659 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:20.991286 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 275/548] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:20.992157 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27ed1e-efb8-4c96-9855-73599672e699 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.039802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:21.083982 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71360c-2cef-4bab-9942-5cfd332ed625 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.094966 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27ed1e-efb8-4c96-9855-73599672e699 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.097372 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:21.119500 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f72f-ca90-44a0-8d5e-01b789260a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.120296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f72f-ca90-44a0-8d5e-01b789260a3e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.120587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f72f-ca90-44a0-8d5e-01b789260a3e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.120870 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47f72f-ca90-44a0-8d5e-01b789260a3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.128002 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.128792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.129088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.129368 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.131820 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47f72f-ca90-44a0-8d5e-01b789260a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:21.139365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-eb47f72f-ca90-44a0-8d5e-01b789260a3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:21.139986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:21.141391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:21.142181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:21.143080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.143232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 274/549] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:21.143232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f72f-ca90-44a0-8d5e-01b789260a3e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:21.163939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:21.165481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:21.166517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:21.166517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:21.166517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:21.166517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:21.166517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 276/550] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:21.166517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.248213 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47f72f-ca90-44a0-8d5e-01b789260a3e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.265312 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:21.269231 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a535-1ce6-4b2e-b309-8e481dd7932c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.284494 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.285164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.285485 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.285761 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.286517 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:21.286836 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.288235 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.300310 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 275/551] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:21.301105 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.304057 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9a3f-976f-4e61-819b-a144cf37cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.305029 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9a3f-976f-4e61-819b-a144cf37cf68 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.310587 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9a3f-976f-4e61-819b-a144cf37cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.310587 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9a3f-976f-4e61-819b-a144cf37cf68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.316691 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a9a3f-976f-4e61-819b-a144cf37cf68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-cf6a9a3f-976f-4e61-819b-a144cf37cf68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:21.324431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:21.325307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:21.326173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 277/552] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:21.327062 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9a3f-976f-4e61-819b-a144cf37cf68 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.347324 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:21.410201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d37fd-7d75-4f90-ac31-1e781959b24a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.431385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9a3f-976f-4e61-819b-a144cf37cf68 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.443898 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.444566 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.444856 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.445125 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.445872 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] RBAC: Adding query filter params (name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:21.446180 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.447616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.456593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 276/553] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:21.457612 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.467944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.468612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.468897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.469179 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.470035 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:21.470340 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.471763 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.483692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 278/554] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:21.484634 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.501276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:21.562177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8ef25-4ff4-431a-959c-73eb4dd4c170 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.563439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:21.586544 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c657-1cc4-4fd0-a3d7-04f119933785 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.597582 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.598380 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.598717 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.599003 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.605783 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.607262 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.621580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:21.621826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:21.622928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:21.623821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:21.623821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:21.623821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:21.623821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:21.623821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:21.623821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:21.623821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:21.623821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:21.624219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.624219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.624219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.624402 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 277/555] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:21.624468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] RBAC: Adding query filter params (name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:21.624533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.624607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.625756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.635455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 279/556] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:21.635853 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.728327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:21.733052 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a886fc-d581-4182-a49f-a446820b8624 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.736124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc08a-e186-4617-8828-6f77cbda075a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.767895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.768765 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.769054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.769333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.770083 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.770902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.771191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.771470 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.778990 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.779382 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.780438 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.780819 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.782446 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:21.795242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:21.798328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 280/557] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:21.799297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:21.802628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:21.804138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:21.805283 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:21.805283 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:21.805283 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:21.805283 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:21.808470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 278/558] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:21.809154 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.905722 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342a254-f71e-4394-bf0c-1a57ac21f0eb None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.908838 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8713-dbbf-474e-9ac3-22033985814b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:21.939429 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.940088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.940376 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.940660 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.941451 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:21.941766 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.943259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.943532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:21.944314 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:21.944601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:21.944877 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:21.955069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:21.956791 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:21.961456 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 281/559] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:21.962266 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:21.974971 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:21.976083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:21.976997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:21.976997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:21.976997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:21.976997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:21.976997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 279/560] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:21.976997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:21.979726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.023870 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.066361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e0767-a025-437c-bb63-174dfab6b509 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.078818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed9c16-0233-4c96-897c-c8e88e14231b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.100302 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.100974 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.101257 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.101534 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.102376 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:22.102716 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.104156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.113366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.114024 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.114336 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.114655 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.115387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:22.115701 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.117073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.121313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 282/561] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:22.122171 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.133470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 280/562] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:22.133470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.189668 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.221798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d90ba-f6e5-4f8b-b3e5-013a20c4c8c0 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.230059 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d63d66-a519-44be-8fd4-a4e2c78c811e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.238399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.255549 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76d6cc-148a-45ba-9150-72c3f3fc961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.256436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76d6cc-148a-45ba-9150-72c3f3fc961a None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.256717 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76d6cc-148a-45ba-9150-72c3f3fc961a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.257008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76d6cc-148a-45ba-9150-72c3f3fc961a None admin] PATH_INFO: `/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/3d3ad9c9521e42f783693c1c4b20cadc/roles/70814e05a0934c5293dcd15c2ce9b60e` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.264271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.264931 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.265222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.265504 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.266394 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:22.266738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.268115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.272088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76d6cc-148a-45ba-9150-72c3f3fc961a None admin] RBAC: Authorizing `identity:create_grant(project_id=cba6578d329149e1b0d2b8c7714d275b, user_id=3d3ad9c9521e42f783693c1c4b20cadc, role_id=70814e05a0934c5293dcd15c2ce9b60e)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.273554 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76d6cc-148a-45ba-9150-72c3f3fc961a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.279706 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 281/563] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:22.280476 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.366814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 283/564] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:33:22 2022] PUT /identity/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/3d3ad9c9521e42f783693c1c4b20cadc/roles/70814e05a0934c5293dcd15c2ce9b60e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:22.367669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76d6cc-148a-45ba-9150-72c3f3fc961a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.384751 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0e7d-265d-481a-b57a-5d23bb2148dd None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.414707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.427070 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.427891 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.428178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.428455 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.440843 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.442345 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:22.463976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:22.464944 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:22.465833 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:22.465833 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:22.465833 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:22.465833 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:22.470987 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 282/565] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:22.472808 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.485595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76d6cc-148a-45ba-9150-72c3f3fc961a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.525319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.526135 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.526426 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.526757 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.537087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.538638 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:22.556335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:22.560801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 284/566] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:22.561975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.591785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.596818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b31fd-f74b-4c2b-99c2-dfec00712b1b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.634525 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.635465 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.635759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.636171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.646324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.647975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:22.663227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:22.664179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:22.665141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 283/567] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:22.665715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.674689 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a683ce6-7253-4a59-8677-919eefd5b277 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.704396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.712795 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.713469 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.713759 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.714044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.714810 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:22.715122 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.716600 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.733349 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 285/568] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:22.733349 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.781711 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15b6d9-93e4-4df8-9e19-0e20c8040449 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.821571 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.822166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.822518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.822806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.823660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:22.823980 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.824246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.825443 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.842409 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646b080-e48c-42d6-ac35-9510ce07ab4e None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:22.846648 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 284/569] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:22.851263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.883963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:22.884642 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:22.884927 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:22.885206 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:22.886045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:22.886361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:22.887858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:22.906955 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 286/570] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:22.907797 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:22.958536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:22.967079 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe7349-e3e0-4d5a-805f-0b44f6c73de5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.007128 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.007933 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.008225 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.008512 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.015359 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d051a1-7c22-437d-89de-03efd1a87aeb None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.016549 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.018016 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:23.035529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:23.036603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:23.037758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:23.037758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:23.037758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:23.037758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:23.037758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:23.037758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:23.037758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:23.037758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:23.043609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 285/571] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:23.043609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.052386 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.053185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.053474 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.053753 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.064494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.065945 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.068515 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:23.085277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:23.086147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:23.087073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:23.087073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:23.087073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:23.087073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:23.087073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 287/572] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:23.088708 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.163089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de8c15-240a-418b-9303-72bd7433b49e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.195072 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d42dba-f12c-4c4e-a217-544dad4a7e7b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.201295 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.202201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.203607 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.203895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.215716 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.217185 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:23.235141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:23.236042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:23.236904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:23.236904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:23.236904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:23.236904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:23.236904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 286/573] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:23.237614 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.238440 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.238899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.239334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.240259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:23.240715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.241810 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.242547 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.245365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:23.255905 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 288/574] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:23.256892 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.324942 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:23.357883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe3a70-c9b5-413d-9172-a6dd4d0a0fdc None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.378173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d60264-f207-48c2-9ea9-954b0aa03459 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.396999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.397665 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.397950 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.398227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.398999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:23.399312 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.401550 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.419103 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 287/575] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:23.419103 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.426433 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.427450 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.427748 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.428195 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.428930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:23.429246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.430672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.443152 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 289/576] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:23.444120 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.487496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:23.530146 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7922487-b8b2-4448-82fc-819d11e45757 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.551235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3293a65-7a63-4931-85b7-70e810d84aad None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.570484 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f9f42-879c-46dd-ae0c-804ac0c7bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.571375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9f42-879c-46dd-ae0c-804ac0c7bda7 None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.571660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9f42-879c-46dd-ae0c-804ac0c7bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.571937 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f9f42-879c-46dd-ae0c-804ac0c7bda7 None admin] PATH_INFO: `/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/362c7977a3564cc1a9c0ff0f0dcc6df6/roles/70814e05a0934c5293dcd15c2ce9b60e` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.572747 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:23.589132 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f9f42-879c-46dd-ae0c-804ac0c7bda7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cba6578d329149e1b0d2b8c7714d275b, user_id=362c7977a3564cc1a9c0ff0f0dcc6df6, role_id=70814e05a0934c5293dcd15c2ce9b60e)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.590631 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f9f42-879c-46dd-ae0c-804ac0c7bda7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.592317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.595781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.595781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.595781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.600795 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.602266 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:23.616096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:23.617067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 290/577] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:23.617979 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.717490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 288/578] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:33:23 2022] PUT /identity/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/362c7977a3564cc1a9c0ff0f0dcc6df6/roles/70814e05a0934c5293dcd15c2ce9b60e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:23.718709 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f9f42-879c-46dd-ae0c-804ac0c7bda7 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.732744 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4950b-ba94-4f90-a930-48671d694387 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.779930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.781126 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.781591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.782016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.790692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.792649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:23.809569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:23.810751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:23.811954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:23.811954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:23.811954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:23.811954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:23.811954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:23.811954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:23.811954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:23.811954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:23.819419 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 291/579] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:23.820634 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.862092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f9f42-879c-46dd-ae0c-804ac0c7bda7 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.864090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:23.882154 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:23.909587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:23.910613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:23.910910 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:23.911192 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:23.912000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:23.912312 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:23.914234 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:23.927725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 289/580] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:23.934745 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:23.950617 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c57b7-fd35-4c94-aa52-72014c6716fc None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:23.999627 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:24.000573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:24.000865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:24.001558 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:24.002662 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:24.002982 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:24.004682 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:24.021666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 292/581] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:24.027244 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:24.042479 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03033e8b-ff99-4f73-9d17-65a04e131c59 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:24.082733 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3081fe-0ff8-4839-88ce-ab0e2392a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:24.083706 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3081fe-0ff8-4839-88ce-ab0e2392a3ed None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:24.083995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3081fe-0ff8-4839-88ce-ab0e2392a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:24.084282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3081fe-0ff8-4839-88ce-ab0e2392a3ed None admin] PATH_INFO: `/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/1a17097c198d491198553e03fd8e8327/roles/70814e05a0934c5293dcd15c2ce9b60e` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:24.107149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3081fe-0ff8-4839-88ce-ab0e2392a3ed None admin] RBAC: Authorizing `identity:create_grant(project_id=cba6578d329149e1b0d2b8c7714d275b, user_id=1a17097c198d491198553e03fd8e8327, role_id=70814e05a0934c5293dcd15c2ce9b60e)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:24.108894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3081fe-0ff8-4839-88ce-ab0e2392a3ed None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:24.141216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:24.146836 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc420846-20d2-4c62-9171-5be07b97cb20 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:24.180643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014ffaf-cde3-45ba-a6af-766285001517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:24.181532 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ffaf-cde3-45ba-a6af-766285001517 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:24.181818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ffaf-cde3-45ba-a6af-766285001517 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:24.182091 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ffaf-cde3-45ba-a6af-766285001517 None admin] PATH_INFO: `/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/3969b99ab3b9410388d56dda5a4e15e0/roles/70814e05a0934c5293dcd15c2ce9b60e` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:24.199475 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014ffaf-cde3-45ba-a6af-766285001517 None admin] RBAC: Authorizing `identity:create_grant(project_id=cba6578d329149e1b0d2b8c7714d275b, user_id=3969b99ab3b9410388d56dda5a4e15e0, role_id=70814e05a0934c5293dcd15c2ce9b60e)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:24.201279 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014ffaf-cde3-45ba-a6af-766285001517 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:24.206923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 290/582] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:33:23 2022] PUT /identity/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/1a17097c198d491198553e03fd8e8327/roles/70814e05a0934c5293dcd15c2ce9b60e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:24.290615 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 293/583] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:33:24 2022] PUT /identity/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/3969b99ab3b9410388d56dda5a4e15e0/roles/70814e05a0934c5293dcd15c2ce9b60e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:24.715831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a3b0-a620-431c-b159-7bb6f59459fb None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:24.716544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a3b0-a620-431c-b159-7bb6f59459fb None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:24.717043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3a3b0-a620-431c-b159-7bb6f59459fb None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:24.718980 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 291/584] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:24.724355 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9d65-aa1b-444e-ba58-1753d9ca0001 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:24.725203 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9d65-aa1b-444e-ba58-1753d9ca0001 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:24.725693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9d65-aa1b-444e-ba58-1753d9ca0001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:24.745314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-afba9d65-aa1b-444e-ba58-1753d9ca0001 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:24.746856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-afba9d65-aa1b-444e-ba58-1753d9ca0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:24.820291 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 294/585] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:24.845206 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3a3b0-a620-431c-b159-7bb6f59459fb None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:24.872702 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:24.955423 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3a3b0-a620-431c-b159-7bb6f59459fb None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:24.992691 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab94fe6-6d1c-434c-83c4-e48a0a5ddba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:24.993887 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab94fe6-6d1c-434c-83c4-e48a0a5ddba5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:24.994398 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab94fe6-6d1c-434c-83c4-e48a0a5ddba5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:24.994919 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab94fe6-6d1c-434c-83c4-e48a0a5ddba5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:25.006642 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab94fe6-6d1c-434c-83c4-e48a0a5ddba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-7ab94fe6-6d1c-434c-83c4-e48a0a5ddba5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:25.014698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:25.029478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:25.030297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 292/586] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:25.031017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9d65-aa1b-444e-ba58-1753d9ca0001 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:25.111451 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:25.141017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9d65-aa1b-444e-ba58-1753d9ca0001 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:25.178169 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:25.178874 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:25.179165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:25.179447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:25.180205 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:25.180516 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:25.181887 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:25.190984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 295/587] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:25.196721 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab94fe6-6d1c-434c-83c4-e48a0a5ddba5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:25.292071 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:25.308536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab94fe6-6d1c-434c-83c4-e48a0a5ddba5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:25.348338 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:25.349084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:25.349714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:25.349997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:25.361665 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:25.363174 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:25.382282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:25.383246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:25.384126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:25.384126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:25.384126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:25.384126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:25.384126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 293/588] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:25.390219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:25.505604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459e0b4-5eb8-45c8-bcc4-3727f5532ed2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:25.544931 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:25.545679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:25.546028 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:25.546313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:25.547187 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:25.547502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:25.549054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:25.556962 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:25.563216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 296/589] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:25.568737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:25.675339 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f1f8-2b65-48ad-8591-5bb75f12ddb7 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:25.711238 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:25.712409 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:25.712895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:25.713370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:25.721324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:25.723124 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:25.724221 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:25.738430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:25.745365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:25.746279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 294/590] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Jul 25 09:33:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:25.748442 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:25.853696 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c47d4-4d17-4de6-996d-f9f83085bf81 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:25.889303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5afe8e-e632-4ba5-b3e8-5b94008cf349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:25.890336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afe8e-e632-4ba5-b3e8-5b94008cf349 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:25.891531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afe8e-e632-4ba5-b3e8-5b94008cf349 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:25.892001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5afe8e-e632-4ba5-b3e8-5b94008cf349 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:25.893048 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5afe8e-e632-4ba5-b3e8-5b94008cf349 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:25.893572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5afe8e-e632-4ba5-b3e8-5b94008cf349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:25.895217 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5afe8e-e632-4ba5-b3e8-5b94008cf349 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:25.919769 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 297/591] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Jul 25 09:33:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:25.926574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:26.032512 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd5529-e24e-48e1-b487-fb7c132f3d9f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:26.068016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5560e7-3b73-46ff-b3a8-c38e6d5fc9b3 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.068329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5560e7-3b73-46ff-b3a8-c38e6d5fc9b3 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.068587 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5560e7-3b73-46ff-b3a8-c38e6d5fc9b3 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.069548 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec15a9-69d7-4281-9812-b497bb98d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:26.070497 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec15a9-69d7-4281-9812-b497bb98d6b0 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.071020 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec15a9-69d7-4281-9812-b497bb98d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.071535 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec15a9-69d7-4281-9812-b497bb98d6b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.073536 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 298/592] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:26.075189 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a453aa-b109-4df5-8960-442f98cdcbcb None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.075478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a453aa-b109-4df5-8960-442f98cdcbcb None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.075757 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a453aa-b109-4df5-8960-442f98cdcbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.094308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-14a453aa-b109-4df5-8960-442f98cdcbcb None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:26.095528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-14a453aa-b109-4df5-8960-442f98cdcbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:26.146670 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:26.157273 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec15a9-69d7-4281-9812-b497bb98d6b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:26.158959 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec15a9-69d7-4281-9812-b497bb98d6b0 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:26.159894 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:26.178726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 299/593] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:33:26.203710 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a453aa-b109-4df5-8960-442f98cdcbcb None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:26.277779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 295/594] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:26.278941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec15a9-69d7-4281-9812-b497bb98d6b0 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:26.349313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a453aa-b109-4df5-8960-442f98cdcbcb None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:26.384741 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:26.391708 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec15a9-69d7-4281-9812-b497bb98d6b0 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:26.397352 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a4e15-681a-4fba-856c-87e1077d51f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:26.398388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4e15-681a-4fba-856c-87e1077d51f1 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.398933 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4e15-681a-4fba-856c-87e1077d51f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.399901 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4e15-681a-4fba-856c-87e1077d51f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.414642 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a4e15-681a-4fba-856c-87e1077d51f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-755a4e15-681a-4fba-856c-87e1077d51f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:26.422743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:26.423678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:26.424477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:26.428782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 300/595] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:26.430029 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a4e15-681a-4fba-856c-87e1077d51f1 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:26.436577 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:26.438198 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.438734 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.439232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.454748 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:26.457035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:26.482456 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:26.483089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:26.483941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:26.484902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:26.484902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:26.484902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:26.484902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:26.493320 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 296/596] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:26.495992 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:26.571580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a4e15-681a-4fba-856c-87e1077d51f1 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:26.615062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7d2d-2dcc-4738-b8e0-f04c99c65d88 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:26.620256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:26.621147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.621594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.622032 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.625257 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] RBAC: Adding query filter params (name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:26.625257 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:26.625932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:26.637466 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 301/597] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:26.643876 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:26.655866 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6bce-c609-4ebd-bc67-c21e2eeba498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:26.657181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6bce-c609-4ebd-bc67-c21e2eeba498 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.657532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6bce-c609-4ebd-bc67-c21e2eeba498 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.657809 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6bce-c609-4ebd-bc67-c21e2eeba498 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.658564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd6bce-c609-4ebd-bc67-c21e2eeba498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:26.658880 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd6bce-c609-4ebd-bc67-c21e2eeba498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:26.660273 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd6bce-c609-4ebd-bc67-c21e2eeba498 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:26.671589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 297/598] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:26.673668 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e32d-4267-4ae7-8f89-f80be5a53fad None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.673974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e32d-4267-4ae7-8f89-f80be5a53fad None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.674242 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e32d-4267-4ae7-8f89-f80be5a53fad None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.676887 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 298/599] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:26.676887 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62de2a8-8476-4f0f-a567-5ab3a613ba8c None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.677447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62de2a8-8476-4f0f-a567-5ab3a613ba8c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.677447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62de2a8-8476-4f0f-a567-5ab3a613ba8c None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.678784 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 299/600] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:26.679347 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62de2a8-8476-4f0f-a567-5ab3a613ba8c None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:26.690402 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:26.757592 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c91af5-6cea-4331-96f0-ab526bd2dd8c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:26.766441 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:26.781802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62de2a8-8476-4f0f-a567-5ab3a613ba8c None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:26.790908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb867b69-4fa2-42a3-b7b8-cf7dc6354682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:26.791688 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb867b69-4fa2-42a3-b7b8-cf7dc6354682 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.791967 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb867b69-4fa2-42a3-b7b8-cf7dc6354682 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.792240 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb867b69-4fa2-42a3-b7b8-cf7dc6354682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.803114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb867b69-4fa2-42a3-b7b8-cf7dc6354682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:26.804583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb867b69-4fa2-42a3-b7b8-cf7dc6354682 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:26.816098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09d061-2590-4fd7-b9d1-06a3d42f4028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:26.816882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09d061-2590-4fd7-b9d1-06a3d42f4028 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.817171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09d061-2590-4fd7-b9d1-06a3d42f4028 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.817445 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09d061-2590-4fd7-b9d1-06a3d42f4028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-eb867b69-4fa2-42a3-b7b8-cf7dc6354682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:26.822390 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:26.823452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:26.824958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:26.824958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:26.824958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:26.824958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:26.824958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 302/601] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:26.824958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed4f5-a9e4-44d7-9c11-96de9b11ff3a None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.825298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed4f5-a9e4-44d7-9c11-96de9b11ff3a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.825460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed4f5-a9e4-44d7-9c11-96de9b11ff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.825545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09d061-2590-4fd7-b9d1-06a3d42f4028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:26.827028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09d061-2590-4fd7-b9d1-06a3d42f4028 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-bb09d061-2590-4fd7-b9d1-06a3d42f4028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:26.842256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:26.843438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 300/602] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10eba8-5ec4-46fc-8f1a-28e08de758db None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:26.846789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10eba8-5ec4-46fc-8f1a-28e08de758db None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:26.848209 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-8b4ed4f5-a9e4-44d7-9c11-96de9b11ff3a None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:26.848728 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10eba8-5ec4-46fc-8f1a-28e08de758db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:26.848918 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-8b4ed4f5-a9e4-44d7-9c11-96de9b11ff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:26.864551 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-af10eba8-5ec4-46fc-8f1a-28e08de758db None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:26.865736 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-af10eba8-5ec4-46fc-8f1a-28e08de758db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:26.915202 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 303/603] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:26.915969 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ed4f5-a9e4-44d7-9c11-96de9b11ff3a None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:26.927383 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:26.934528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 301/604] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:26.934528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10eba8-5ec4-46fc-8f1a-28e08de758db None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.028251 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:27.031951 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10eba8-5ec4-46fc-8f1a-28e08de758db None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.037845 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ed4f5-a9e4-44d7-9c11-96de9b11ff3a None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.068203 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.068865 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.069150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.069427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.070213 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:27.070554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.071996 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.072555 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.073255 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.073543 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.073818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.074561 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:27.074871 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.076208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.083981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 302/605] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:27.084776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.087955 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 304/606] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:27.088899 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.144314 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:27.185785 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e832c2-e85e-48d8-9702-5e53621f6f97 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.187273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a0e30-b7fa-4f9b-87d4-b1566dc5e687 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.219780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ed00-7695-45e8-ad81-d1016b3f3450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.220568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ed00-7695-45e8-ad81-d1016b3f3450 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.220853 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ed00-7695-45e8-ad81-d1016b3f3450 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.221130 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ed00-7695-45e8-ad81-d1016b3f3450 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.221291 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384a1b5-916c-48c4-be8d-97ccc12fff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.222083 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a1b5-916c-48c4-be8d-97ccc12fff17 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.222368 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a1b5-916c-48c4-be8d-97ccc12fff17 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.222681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a1b5-916c-48c4-be8d-97ccc12fff17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.231079 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760ed00-7695-45e8-ad81-d1016b3f3450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:27.232609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384a1b5-916c-48c4-be8d-97ccc12fff17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-a760ed00-7695-45e8-ad81-d1016b3f3450 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:27.239447 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:27.240591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:27.246545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 303/607] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-4384a1b5-916c-48c4-be8d-97ccc12fff17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:27.247280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:27.248115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:33:27.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:27.249558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ed00-7695-45e8-ad81-d1016b3f3450 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.249645 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 305/608] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:27.249645 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384a1b5-916c-48c4-be8d-97ccc12fff17 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.258147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:27.347218 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384a1b5-916c-48c4-be8d-97ccc12fff17 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.352824 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ed00-7695-45e8-ad81-d1016b3f3450 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.369470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:27.381241 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.382040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.382330 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.382649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.386309 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.386993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.387288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.387569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.388452 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=3d3ad9c9521e42f783693c1c4b20cadc) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:27.388769 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.390198 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.390288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.392292 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.397313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 304/609] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/role_assignments?user.id=3d3ad9c9521e42f783693c1c4b20cadc&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:27.398106 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:27.406953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:27.408081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 09:33:27.409042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:27.409569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 306/610] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:27.410225 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.494775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:27.528410 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4064f-1b78-4a7f-902f-eea2971c9304 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.529973 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2e19f-1532-4877-9397-1bb466844867 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.569708 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.570396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.570720 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.571006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.571795 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] RBAC: Adding query filter params (name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:27.572108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.572737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.573408 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.573694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.573969 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.574345 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.574751 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:27.575060 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.576415 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.585955 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 305/611] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:27.586830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.592457 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 307/612] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:27.594006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.642813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:27.705190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcee3a5-0e74-45e3-9b60-ec843c112a32 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.708784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711310-b27c-4dce-8372-89de28d00f33 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.740209 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:27.743526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.744212 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.744504 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.744841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.745269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.745634 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:27.745954 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.746074 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.746707 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.746990 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.747627 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.759537 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.761153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.767363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 306/613] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:27.767671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:27.783334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:27.792254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:27.794007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:27.794007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:27.794007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:27.794007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:27.794007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 308/614] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:27.794007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:27.893732 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d840f9d-5ced-435b-a5f7-006e27a316a5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.895287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:27.905281 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c3bf3-29bb-4cba-a97b-accc3ab77473 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:27.930675 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.931473 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.931756 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.932031 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.943682 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:27.944619 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3c677-0a1e-4867-8588-c75299843c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:27.945158 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:27.945261 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3c677-0a1e-4867-8588-c75299843c07 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:27.945550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3c677-0a1e-4867-8588-c75299843c07 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:27.945805 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3c677-0a1e-4867-8588-c75299843c07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:27.963621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:27.964561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:27.965431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:27.965431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:27.965431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:27.965431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:27.965431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 307/615] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:27.965710 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.009314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.026709 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3c677-0a1e-4867-8588-c75299843c07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.028276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3c677-0a1e-4867-8588-c75299843c07 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.067245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb49b8-23d9-4753-b36e-122df246e322 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.101761 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.102424 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.102743 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.103019 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.103742 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:28.104044 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.105406 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.117428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 308/616] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:28.118054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.135207 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.141517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 309/617] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:28.142645 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3c677-0a1e-4867-8588-c75299843c07 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.227681 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86486504-6f48-4d10-b482-1b80b1592d91 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.230190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.246832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3c677-0a1e-4867-8588-c75299843c07 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.266665 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.267336 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.267622 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.267903 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.268816 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:28.269055 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.270444 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.287394 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 309/618] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:28.288602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.294108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.294940 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.295224 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.295501 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.304995 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.306459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:28.321951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:28.322923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:28.323844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 310/619] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:28.324415 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.376350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.401274 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10073039-b3d4-450b-b9c3-71087486b981 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.437289 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebce108-8138-46af-b776-2ea2b879bf46 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.439425 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.440223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.440510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.440788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.452052 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.454388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.473012 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.473807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.474087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:28.474293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:28.475360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:28.476270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:28.476270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:28.476270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:28.476270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:28.476499 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.476581 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 310/620] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:28.476581 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.487953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.489420 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:28.504798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:28.505818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 311/621] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:28.507199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.512159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.591814 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ac85-5e35-420a-9f08-6f91e05315d1 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.613532 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06e80-efea-4927-a71f-391ec115fd94 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.620561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.629754 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.630505 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.630799 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.632241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.632241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:28.632241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.633784 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.654210 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 311/622] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:28.655124 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.665627 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.667071 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.667546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.667999 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.669460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:28.669973 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.672139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.692591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 312/623] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:28.692591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.761305 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.771296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6269cb-0172-4a46-b58f-12f7444a1607 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.801364 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d243f-a96c-4ce2-a793-2b2761e06cc0 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.806895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.807571 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.807862 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.808150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.808985 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:28.809301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.810780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.830703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 312/624] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:28.832053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:28.852561 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62097ef-71d9-44b9-aed1-6ff46ac7becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.852561 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62097ef-71d9-44b9-aed1-6ff46ac7becb None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.852561 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62097ef-71d9-44b9-aed1-6ff46ac7becb None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.852561 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62097ef-71d9-44b9-aed1-6ff46ac7becb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.880333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.925151 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62097ef-71d9-44b9-aed1-6ff46ac7becb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:28.926644 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62097ef-71d9-44b9-aed1-6ff46ac7becb None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:28.948748 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaddec-0082-4b8c-9944-1ec02909a5e6 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:28.989503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:28.990270 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:28.990684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:28.991159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:28.991862 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:28.999913 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.001558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:29.019533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:29.020463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:29.021349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:29.021349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:29.021349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:29.021349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:29.021349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:29.021349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:29.021349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:29.021349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:29.021779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 313/625] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:29.022423 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.036138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 313/626] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:29.036138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62097ef-71d9-44b9-aed1-6ff46ac7becb None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.137026 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62097ef-71d9-44b9-aed1-6ff46ac7becb None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.141836 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e82514-b6d0-46be-b4ea-f4b8e36c299c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.143388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:29.175328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.176145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.176431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.176705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.177486 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:29.177798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.179270 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.187141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6c2c2-db86-4331-a520-7a7bee4f9569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.188348 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6c2c2-db86-4331-a520-7a7bee4f9569 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.189164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6c2c2-db86-4331-a520-7a7bee4f9569 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.189464 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6c2c2-db86-4331-a520-7a7bee4f9569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.192054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 314/627] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:29.195376 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.224536 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:29.266539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6c2c2-db86-4331-a520-7a7bee4f9569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.268002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6c2c2-db86-4331-a520-7a7bee4f9569 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.306618 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5174c-0ad9-4405-bb50-504a98a5240d None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.350434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.351276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.351552 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.351835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.364366 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.365834 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.381466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 314/628] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:29.381466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6c2c2-db86-4331-a520-7a7bee4f9569 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.382422 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:29.385282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:29.386149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:29.396518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:29.396518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:29.396518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:29.396518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:29.396518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 315/629] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:29.396518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.482905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6c2c2-db86-4331-a520-7a7bee4f9569 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.484298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:29.509098 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb21d5f-cc3f-44ce-a798-501b79cda4df None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.521551 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.522236 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.522554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.522842 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.523681 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=362c7977a3564cc1a9c0ff0f0dcc6df6) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:29.524007 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.525473 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.542502 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 315/630] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/role_assignments?user.id=362c7977a3564cc1a9c0ff0f0dcc6df6&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:29.542502 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.559019 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.560074 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.560417 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.560767 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.574461 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.576358 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:29.599268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:29.603282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:29.604178 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:29.604178 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:29.604178 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:29.604178 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:29.604178 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 316/631] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:29.607011 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.628387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:29.668137 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776e9ad-db7a-48d1-9716-c6f4dc43ef37 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.710507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.710507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.710507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.710507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.710979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:29.710979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.713033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.735082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 316/632] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:29.743895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.745253 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aa564-213d-4bf1-a4c3-0c0f32c93f68 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.779222 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:29.789378 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc889b88-44e1-47eb-aa0c-5549c87b3beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.793003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889b88-44e1-47eb-aa0c-5549c87b3beb None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.793003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889b88-44e1-47eb-aa0c-5549c87b3beb None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.793003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc889b88-44e1-47eb-aa0c-5549c87b3beb None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.793003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889b88-44e1-47eb-aa0c-5549c87b3beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:29.793003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889b88-44e1-47eb-aa0c-5549c87b3beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.793003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc889b88-44e1-47eb-aa0c-5549c87b3beb None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.806427 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 317/633] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:29.807816 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fca16-109d-41f7-bb24-39f9195c532a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.808110 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fca16-109d-41f7-bb24-39f9195c532a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.808394 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fca16-109d-41f7-bb24-39f9195c532a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.809644 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 318/634] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:29.812641 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fca16-109d-41f7-bb24-39f9195c532a None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:29.861999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7dce0-87ef-463a-970f-6dd20f758b68 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.893168 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:29.902163 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f03f76-4d99-4eff-a065-0c4a6e8002fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.903272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03f76-4d99-4eff-a065-0c4a6e8002fe None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.903729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03f76-4d99-4eff-a065-0c4a6e8002fe None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.904177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03f76-4d99-4eff-a065-0c4a6e8002fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.912305 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f03f76-4d99-4eff-a065-0c4a6e8002fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.914019 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f03f76-4d99-4eff-a065-0c4a6e8002fe None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-78f03f76-4d99-4eff-a065-0c4a6e8002fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:29.930501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:29.931586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:29.932450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:29.932450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:29.932450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:29.932450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:29.932450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:29.932450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:29.932450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:29.932450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:29.935113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 317/635] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:29.936486 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73381e3-7298-4385-a2e7-da279c2a4d4d None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.936783 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73381e3-7298-4385-a2e7-da279c2a4d4d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.936892 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fca16-109d-41f7-bb24-39f9195c532a None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:29.937060 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73381e3-7298-4385-a2e7-da279c2a4d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.956921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-b73381e3-7298-4385-a2e7-da279c2a4d4d None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:29.959249 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-b73381e3-7298-4385-a2e7-da279c2a4d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:29.976385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:29.977194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:29.977482 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:29.977762 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:29.986129 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:29.987636 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:30.002159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:30.003316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 319/636] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:30.004698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:30.042501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 318/637] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:30.042501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73381e3-7298-4385-a2e7-da279c2a4d4d None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:30.075363 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:30.131942 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe051a-3427-4a7f-b3eb-ac50d29d111f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:30.151020 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73381e3-7298-4385-a2e7-da279c2a4d4d None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:30.168827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:30.169723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:30.170170 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:30.170335 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:30.170434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:30.171259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:30.171574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:30.173119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:30.190285 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:30.191207 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:30.191317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 320/638] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:30.191398 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:30.191469 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:30.191940 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:30.192330 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:30.192576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:30.194081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:30.212923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 319/639] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:30.212923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:30.308865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4d4fd-ab70-49ec-88a0-231ceda2b89e None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:30.323957 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:30.324841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb16f6c-f6e5-4987-8586-1902d484768c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:30.350931 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bf48b-c48d-4031-8cbb-1b6f3eaaa4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:30.351739 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf48b-c48d-4031-8cbb-1b6f3eaaa4d9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:30.352009 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf48b-c48d-4031-8cbb-1b6f3eaaa4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:30.352285 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf48b-c48d-4031-8cbb-1b6f3eaaa4d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:30.363770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bf48b-c48d-4031-8cbb-1b6f3eaaa4d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:30.366513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:30.367173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:30.367454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:30.367727 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:30.368558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=3969b99ab3b9410388d56dda5a4e15e0) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:30.368867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:30.370291 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-004bf48b-c48d-4031-8cbb-1b6f3eaaa4d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:30.372008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:30.373181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 321/640] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:30.374066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bf48b-c48d-4031-8cbb-1b6f3eaaa4d9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:30.395413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 320/641] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/role_assignments?user.id=3969b99ab3b9410388d56dda5a4e15e0&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:30.395413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:30.438855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:30.522309 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bf48b-c48d-4031-8cbb-1b6f3eaaa4d9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:30.527284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73111a4-d1af-4674-991d-0ac648bbe292 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:30.566310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:30.567208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:30.567633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:30.568020 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:30.569036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=1a17097c198d491198553e03fd8e8327) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:30.569521 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:30.571127 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:30.577696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:30.579054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 322/642] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/role_assignments?user.id=1a17097c198d491198553e03fd8e8327&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:30.579358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:30.579651 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:30.580043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:30.580794 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:30.581358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:30.583897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:30.597307 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 321/643] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:30.599761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:30.637409 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:30.719499 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee586fb1-5c8d-4ebd-a487-977960d79480 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:30.758782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:30.760077 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:30.760574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:30.761085 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:30.774214 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:30.776119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:30.796566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:30.798572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:30.799508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:30.799508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:30.799508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:30.799508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:30.800349 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 323/644] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:30.805961 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:30.923301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10643822-5c57-4f42-b147-113d42c6a952 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:30.924870 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:30.959059 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:30.959873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:30.960047 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:30.960384 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:30.961121 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:30.961479 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:30.962844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:30.975889 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 322/645] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:30.981670 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:31.076978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:31.094054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aeb2f-e1bd-4576-907b-b98e1f3d15be None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:31.129318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:31.130117 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:31.130403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:31.130704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:31.139734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:31.141371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:31.155800 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:31.157296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:31.158454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 324/646] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Jul 25 09:33:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:31.165576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:31.279024 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431a441-57f2-4850-be53-995bcefee614 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:31.315604 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:31.316284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:31.316572 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:31.316854 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:31.317696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:31.318009 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:31.319491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:31.339429 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 323/647] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Jul 25 09:33:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:31.345949 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:31.452285 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803414b0-d963-4399-a826-a49fc5d66c77 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:31.489153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e384f-0cbc-41f7-986d-dd2eb840ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:31.489810 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e384f-0cbc-41f7-986d-dd2eb840ddfc None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:31.490095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e384f-0cbc-41f7-986d-dd2eb840ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:31.490373 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e384f-0cbc-41f7-986d-dd2eb840ddfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:31.506815 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:31.562152 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e384f-0cbc-41f7-986d-dd2eb840ddfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:31.563990 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e384f-0cbc-41f7-986d-dd2eb840ddfc None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:31.671171 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 325/648] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 09:33:31.679592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:31.702564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:31.794638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e029be9-7a28-4dea-82b3-a5636f7e40a5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:31.830196 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e126a4-243e-496a-9782-757436689458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:31.831336 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e126a4-243e-496a-9782-757436689458 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:31.831623 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e126a4-243e-496a-9782-757436689458 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:31.831900 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e126a4-243e-496a-9782-757436689458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:31.842435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e126a4-243e-496a-9782-757436689458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:31.844283 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e126a4-243e-496a-9782-757436689458 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-77e126a4-243e-496a-9782-757436689458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:31.862601 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:31.863513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:31.864396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:31.864396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:31.864396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:31.864396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:31.864396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 324/649] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:31.870499 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e384f-0cbc-41f7-986d-dd2eb840ddfc None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:31.910162 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463a4a-dca4-4d49-9469-32745a2103ba None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:31.910518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463a4a-dca4-4d49-9469-32745a2103ba None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:31.910769 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92463a4a-dca4-4d49-9469-32745a2103ba None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:31.912366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 325/650] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:31.917178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdd04-a869-4a4b-873b-8d0807638d67 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:31.917463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdd04-a869-4a4b-873b-8d0807638d67 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:31.917736 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcdd04-a869-4a4b-873b-8d0807638d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:31.923403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:31.944839 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-f7bcdd04-a869-4a4b-873b-8d0807638d67 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:31.947212 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-f7bcdd04-a869-4a4b-873b-8d0807638d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:31.982972 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e384f-0cbc-41f7-986d-dd2eb840ddfc None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:32.022114 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:32.022976 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.023365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.023769 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.024602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:32.025018 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:32.026559 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:32.038891 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 326/651] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 09:33:32.050532 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 326/652] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:32.050681 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcdd04-a869-4a4b-873b-8d0807638d67 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:32.051135 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:32.064608 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:32.174213 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49eed6-f285-4658-b2bd-5ac7183e3250 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:32.175593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcdd04-a869-4a4b-873b-8d0807638d67 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:32.178784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:32.215136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:32.216662 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.217249 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.217888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.222894 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:32.223832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.224234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.224705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.225438 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:32.226919 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:32.228399 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:32.230150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:32.243354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:32.244422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:32.245272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 327/653] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Jul 25 09:33:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:32.249109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:32.250041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:32.251201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:32.251201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:32.251201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:32.251201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:32.251201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:32.251201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:32.251201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:32.251201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:32.258238 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:32.258501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 327/654] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:32.259925 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:32.347282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:32.386784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0aad83-7d26-4454-9497-d3a174d807ac None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:32.387713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aae29-0b35-40c5-a168-de57649ede48 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:32.425399 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:32.425997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.426289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.426653 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.427505 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:32.427820 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:32.429293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:32.438928 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:32.439925 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.440410 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.440902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.442351 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:32.442897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:32.444713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:32.454516 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 328/656] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:32.454854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 328/656] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Jul 25 09:33:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:32.455914 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:32.457459 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:32.494363 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:32.586513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c079-0259-42c5-acc8-12bde3187639 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:32.587955 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3beedf9-d3c7-443a-8876-b853523c6547 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:32.624819 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:32.628061 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514bd3f-e030-46bf-88c2-facfb246d158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:32.628814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514bd3f-e030-46bf-88c2-facfb246d158 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.629282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514bd3f-e030-46bf-88c2-facfb246d158 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.629644 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514bd3f-e030-46bf-88c2-facfb246d158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.630840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514bd3f-e030-46bf-88c2-facfb246d158 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=3d3ad9c9521e42f783693c1c4b20cadc) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:32.631252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514bd3f-e030-46bf-88c2-facfb246d158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:32.632845 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514bd3f-e030-46bf-88c2-facfb246d158 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:32.641775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c68c7-db2e-4463-a6d4-eceaa43097b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:32.642854 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c68c7-db2e-4463-a6d4-eceaa43097b2 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.643332 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c68c7-db2e-4463-a6d4-eceaa43097b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.643803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c68c7-db2e-4463-a6d4-eceaa43097b2 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.644759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c68c7-db2e-4463-a6d4-eceaa43097b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:32.645298 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c68c7-db2e-4463-a6d4-eceaa43097b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:32.646510 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 329/657] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:32 2022] GET /identity/v3/role_assignments?user.id=3d3ad9c9521e42f783693c1c4b20cadc&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=bd8b88fae376413398183761500b2e1d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:32.647368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c68c7-db2e-4463-a6d4-eceaa43097b2 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:32.654940 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 329/658] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Jul 25 09:33:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:32.799562 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098a0c-f5b0-45cb-ae90-17f0c53d3891 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.799878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098a0c-f5b0-45cb-ae90-17f0c53d3891 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.800303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2098a0c-f5b0-45cb-ae90-17f0c53d3891 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.802195 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 330/659] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:32.808331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6cac8-83a2-4380-ba99-083f25d52fa7 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:32.808711 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6cac8-83a2-4380-ba99-083f25d52fa7 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:32.809068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6cac8-83a2-4380-ba99-083f25d52fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:32.830663 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-46e6cac8-83a2-4380-ba99-083f25d52fa7 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:32.832562 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-46e6cac8-83a2-4380-ba99-083f25d52fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:32.911558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 330/660] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:32.935052 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2098a0c-f5b0-45cb-ae90-17f0c53d3891 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:33.039616 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:33.046252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2098a0c-f5b0-45cb-ae90-17f0c53d3891 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:33.082782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:33.083507 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:33.083789 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:33.084073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] PATH_INFO: `/v3/services/network` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:33.084731 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:33.086586 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:33.087609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7428-6d42-4f85-a045-1cb68f340ea3 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:33.088072 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7428-6d42-4f85-a045-1cb68f340ea3 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:33.088180 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7428-6d42-4f85-a045-1cb68f340ea3 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:33.089798 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 331/661] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:33.095087 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d780-4635-40a3-8e73-60dbc936819f None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:33.095380 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d780-4635-40a3-8e73-60dbc936819f None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:33.095663 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d780-4635-40a3-8e73-60dbc936819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:33.101850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:33.103065 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:33.104080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:33.106309 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 331/662] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:32 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:33.113163 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:33.118910 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-a234d780-4635-40a3-8e73-60dbc936819f None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:33.120646 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-a234d780-4635-40a3-8e73-60dbc936819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:33.214639 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 332/663] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:33.231206 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88bc8-d772-40ff-91b6-614c8ad511cc None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:33.241058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234d780-4635-40a3-8e73-60dbc936819f None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:33.281528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:33.282700 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:33.283094 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:33.283476 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:33.284351 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] RBAC: Adding query filter params (name=network) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:33.284784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:33.287258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:33.292902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 332/664] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:33.298699 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:33.300865 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:33.326862 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:33.362873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234d780-4635-40a3-8e73-60dbc936819f None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:33.403817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:33.404916 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:33.405504 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:33.405962 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:33.406932 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:33.408467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:33.423904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:33.425150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:33.426170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:33.428755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 333/665] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Jul 25 09:33:33 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:33.430950 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5697b4-46c7-4404-8148-e8f3a11261de None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:33.435434 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:33.473054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:33.474070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:33.474543 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:33.475113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:33.476093 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:33.476551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:33.478130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:33.498736 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 333/666] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:33.560344 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488d80c-1332-40f4-b9bb-6804b513a0f3 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:33.579019 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:33.600686 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336afcfb-c0d9-4076-8b2e-cb09eef1fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:33.601917 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336afcfb-c0d9-4076-8b2e-cb09eef1fcaa None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:33.602551 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336afcfb-c0d9-4076-8b2e-cb09eef1fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:33.603276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336afcfb-c0d9-4076-8b2e-cb09eef1fcaa None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:33.604099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336afcfb-c0d9-4076-8b2e-cb09eef1fcaa None admin] RBAC: Adding query filter params (name=image) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:33.604506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336afcfb-c0d9-4076-8b2e-cb09eef1fcaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:33.605993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336afcfb-c0d9-4076-8b2e-cb09eef1fcaa None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:33.616040 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 334/667] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:33.617452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:33.715076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:33.728132 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad317cb-ed37-4f9a-8835-37863c3057f9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:33.763784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99c2bc-30fa-4fe3-aad7-4fc0384c42f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:33.764601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99c2bc-30fa-4fe3-aad7-4fc0384c42f5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:33.764977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99c2bc-30fa-4fe3-aad7-4fc0384c42f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:33.765915 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99c2bc-30fa-4fe3-aad7-4fc0384c42f5 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:33.766748 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99c2bc-30fa-4fe3-aad7-4fc0384c42f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:33.767153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99c2bc-30fa-4fe3-aad7-4fc0384c42f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:33.768630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99c2bc-30fa-4fe3-aad7-4fc0384c42f5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:33.778637 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 334/668] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:34.929185 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a2224-7e2b-48b4-aa51-2e5cc1d2aca8 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:34.929858 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a2224-7e2b-48b4-aa51-2e5cc1d2aca8 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:34.929858 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a2224-7e2b-48b4-aa51-2e5cc1d2aca8 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:34.931567 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 335/669] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:34.937805 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46d5a-11b5-461c-9248-056e1c7e0a42 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:34.938337 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46d5a-11b5-461c-9248-056e1c7e0a42 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:34.938337 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc46d5a-11b5-461c-9248-056e1c7e0a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:34.957686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-7fc46d5a-11b5-461c-9248-056e1c7e0a42 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:34.969355 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-7fc46d5a-11b5-461c-9248-056e1c7e0a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:35.084104 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 335/670] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:35.110633 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d2a2-5cf3-477b-85e0-18b10ed07d67 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:35.111271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d2a2-5cf3-477b-85e0-18b10ed07d67 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:35.111755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d2a2-5cf3-477b-85e0-18b10ed07d67 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:35.113736 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 336/671] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:35.119365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806cd3-1125-4b7a-82f0-54a293126e28 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:35.119914 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806cd3-1125-4b7a-82f0-54a293126e28 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:35.120411 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f806cd3-1125-4b7a-82f0-54a293126e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:35.123531 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12d2a2-5cf3-477b-85e0-18b10ed07d67 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:35.159304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-8f806cd3-1125-4b7a-82f0-54a293126e28 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:35.161773 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-8f806cd3-1125-4b7a-82f0-54a293126e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:35.294610 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 336/672] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:35.319829 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f806cd3-1125-4b7a-82f0-54a293126e28 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:35.320278 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12d2a2-5cf3-477b-85e0-18b10ed07d67 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:35.344314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:35.398899 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9213b6-10b7-42fd-84df-14107b9b9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:35.400858 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9213b6-10b7-42fd-84df-14107b9b9da5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:35.401357 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9213b6-10b7-42fd-84df-14107b9b9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:35.403231 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9213b6-10b7-42fd-84df-14107b9b9da5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:35.429941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9213b6-10b7-42fd-84df-14107b9b9da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-cb9213b6-10b7-42fd-84df-14107b9b9da5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:35.438108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:35.439173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:35.440054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:35.441586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 337/673] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:33:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:35.451879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9213b6-10b7-42fd-84df-14107b9b9da5 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:35.483413 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f806cd3-1125-4b7a-82f0-54a293126e28 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:35.521596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:35.539268 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764333-d608-4973-8af0-ea43497b0445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:35.540355 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764333-d608-4973-8af0-ea43497b0445 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:35.540897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764333-d608-4973-8af0-ea43497b0445 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:35.541886 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764333-d608-4973-8af0-ea43497b0445 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:35.543446 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5764333-d608-4973-8af0-ea43497b0445 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:35.545806 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5764333-d608-4973-8af0-ea43497b0445 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:35.592100 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9213b6-10b7-42fd-84df-14107b9b9da5 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:35.628075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:35.628743 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:35.629037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:35.629309 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:35.630054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:35.630364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:35.631811 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:35.647130 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 338/675] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:35.647488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 337/675] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:33:35 2022] POST /identity/v3/services => generated 251 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:33:35.648970 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:35.764873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:35.772228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a4847-68d0-4428-b540-245961cf3fd3 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:35.819008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682dd71-c556-43c3-9748-8b92e6b147c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:35.819733 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682dd71-c556-43c3-9748-8b92e6b147c9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:35.820014 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682dd71-c556-43c3-9748-8b92e6b147c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:35.820289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682dd71-c556-43c3-9748-8b92e6b147c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:35.837172 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682dd71-c556-43c3-9748-8b92e6b147c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:35.839061 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682dd71-c556-43c3-9748-8b92e6b147c9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-6682dd71-c556-43c3-9748-8b92e6b147c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:35.860803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:35.861802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:35.862749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:35.862749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:35.862749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:35.862749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:35.865110 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 339/676] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:35.871585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764333-d608-4973-8af0-ea43497b0445 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:35.900081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afcd6-7f97-47c0-8c58-851fa2fbfb6d None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:35.900384 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afcd6-7f97-47c0-8c58-851fa2fbfb6d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:35.900650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1afcd6-7f97-47c0-8c58-851fa2fbfb6d None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:35.902325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 340/677] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:35.908674 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72ae9-749e-496b-8fa3-4f8bf60946f6 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:35.909048 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72ae9-749e-496b-8fa3-4f8bf60946f6 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:35.909335 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72ae9-749e-496b-8fa3-4f8bf60946f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:35.928818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-95e72ae9-749e-496b-8fa3-4f8bf60946f6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:35.929876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-95e72ae9-749e-496b-8fa3-4f8bf60946f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:35.984998 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:36.000312 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764333-d608-4973-8af0-ea43497b0445 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:36.019955 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 341/678] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 09:33:36.040869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:36.041550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.041877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.042166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.042943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:36.043313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:36.045075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:36.045912 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e72ae9-749e-496b-8fa3-4f8bf60946f6 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:36.066515 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 338/679] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:36.075529 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:36.139644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:36.165644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e72ae9-749e-496b-8fa3-4f8bf60946f6 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:36.189940 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fefc17-35be-4fc7-89d6-088e67f95f41 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:36.203629 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6c11b-4a91-457a-be34-eb4f1996f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:36.204538 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c11b-4a91-457a-be34-eb4f1996f0b8 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.205013 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c11b-4a91-457a-be34-eb4f1996f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.205296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c11b-4a91-457a-be34-eb4f1996f0b8 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.206268 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6c11b-4a91-457a-be34-eb4f1996f0b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:36.207777 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6c11b-4a91-457a-be34-eb4f1996f0b8 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:36.222041 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:36.227054 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced1e8-8777-42ef-83b6-394730e4d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:36.227859 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced1e8-8777-42ef-83b6-394730e4d187 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.228145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced1e8-8777-42ef-83b6-394730e4d187 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.228446 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced1e8-8777-42ef-83b6-394730e4d187 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.236378 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ced1e8-8777-42ef-83b6-394730e4d187 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:36.237838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ced1e8-8777-42ef-83b6-394730e4d187 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-a3ced1e8-8777-42ef-83b6-394730e4d187 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:36.252444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:36.253704 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 339/680] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Jul 25 09:33:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:36.255143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72c89-3c2d-4bc5-a5e0-c1ee624d7e40 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.255794 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72c89-3c2d-4bc5-a5e0-c1ee624d7e40 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.255794 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72c89-3c2d-4bc5-a5e0-c1ee624d7e40 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.260631 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 340/681] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:36.261376 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72c89-3c2d-4bc5-a5e0-c1ee624d7e40 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:36.284884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 342/682] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:33:36 2022] POST /identity/v3/services => generated 240 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:33:36.289331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121199d-b3a7-4b9e-9395-9b0de0b72e16 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.289331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121199d-b3a7-4b9e-9395-9b0de0b72e16 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.289331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121199d-b3a7-4b9e-9395-9b0de0b72e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.310349 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-8121199d-b3a7-4b9e-9395-9b0de0b72e16 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:36.312091 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-8121199d-b3a7-4b9e-9395-9b0de0b72e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:36.406853 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 343/683] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:36.417705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72c89-3c2d-4bc5-a5e0-c1ee624d7e40 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:36.434025 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121199d-b3a7-4b9e-9395-9b0de0b72e16 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:36.472672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:36.473925 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.475236 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.475695 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.476615 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:36.476939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:36.478502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:36.500752 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 341/684] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Jul 25 09:33:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:36.504738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:36.506348 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:36.556503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121199d-b3a7-4b9e-9395-9b0de0b72e16 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:36.567041 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:36.598532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b7aee-ae03-487d-9b15-2455a34502e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:36.599270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b7aee-ae03-487d-9b15-2455a34502e4 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.599628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b7aee-ae03-487d-9b15-2455a34502e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.599979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b7aee-ae03-487d-9b15-2455a34502e4 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.600780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b7aee-ae03-487d-9b15-2455a34502e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:36.602272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b7aee-ae03-487d-9b15-2455a34502e4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:36.629595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3eab0-544e-4795-b4dd-3a22de1de198 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:36.670833 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:36.672577 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.672871 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.673245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.682958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 344/685] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:33:36 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:33:36.693079 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:36.694832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:36.715897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:36.716861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:36.717775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:36.717775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:36.717775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:36.717775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:36.717775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 342/686] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:36.723037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b7aee-ae03-487d-9b15-2455a34502e4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:36.847057 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b7aee-ae03-487d-9b15-2455a34502e4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:36.869970 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:36.890221 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:36.890960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:36.891248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:36.891528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:36.892267 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:36.892583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:36.894046 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:36.912379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 345/687] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:36.918205 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:37.027574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142b1c5-2dad-4b4c-93e7-91385d81bc68 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:37.029919 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:37.065048 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:37.065856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:37.066143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:37.066422 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:37.073578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:37.075067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:37.089511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:37.090488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:37.091405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 343/688] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:37.097426 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:37.205209 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72f48-e3b7-4da5-b082-da6767af528c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:37.241574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ed574-f81f-4c3e-b227-4f82312e4977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:37.242627 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ed574-f81f-4c3e-b227-4f82312e4977 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:37.243121 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ed574-f81f-4c3e-b227-4f82312e4977 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:37.243597 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ed574-f81f-4c3e-b227-4f82312e4977 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:37.244587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ed574-f81f-4c3e-b227-4f82312e4977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:37.245104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ed574-f81f-4c3e-b227-4f82312e4977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:37.246786 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ed574-f81f-4c3e-b227-4f82312e4977 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:37.259921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 346/689] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:37.268832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:37.386725 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398178a-6ac8-45e1-8c8c-76359bfbc7ed None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:37.429669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab76b1c-fd88-4c21-8bc8-30e17159a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:37.430605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab76b1c-fd88-4c21-8bc8-30e17159a8a1 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:37.431194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab76b1c-fd88-4c21-8bc8-30e17159a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:37.431686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab76b1c-fd88-4c21-8bc8-30e17159a8a1 None admin] PATH_INFO: `/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/3d3ad9c9521e42f783693c1c4b20cadc/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:37.434854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab76b1c-fd88-4c21-8bc8-30e17159a8a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cba6578d329149e1b0d2b8c7714d275b, user_id=3d3ad9c9521e42f783693c1c4b20cadc, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:37.436307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab76b1c-fd88-4c21-8bc8-30e17159a8a1 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:37.518697 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 344/690] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:33:37 2022] PUT /identity/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/3d3ad9c9521e42f783693c1c4b20cadc/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:33:38.017249 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c12b-af35-4485-a6e7-be504b834d34 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.018020 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c12b-af35-4485-a6e7-be504b834d34 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.018553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c12b-af35-4485-a6e7-be504b834d34 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.020598 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 347/691] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:38.026350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9c1f6-f243-4433-9642-99d64012f678 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.027023 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9c1f6-f243-4433-9642-99d64012f678 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.027513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9c1f6-f243-4433-9642-99d64012f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.048142 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-0ea9c1f6-f243-4433-9642-99d64012f678 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:38.050102 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-0ea9c1f6-f243-4433-9642-99d64012f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:38.068611 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:38.123843 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 345/692] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:38.147460 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670c12b-af35-4485-a6e7-be504b834d34 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:38.185034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:38.258768 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670c12b-af35-4485-a6e7-be504b834d34 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:38.294602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:38.295351 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.295636 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.295911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.297151 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:38.298620 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:38.310993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:38.312023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:38.313453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 348/693] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Jul 25 09:33:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:38.318735 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9c1f6-f243-4433-9642-99d64012f678 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:38.424255 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9c1f6-f243-4433-9642-99d64012f678 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:38.462409 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:38.463105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.463391 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.463670 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.464374 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:38.464680 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:38.466058 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:38.471275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 346/694] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Jul 25 09:33:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:38.479538 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:38.588848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:38.592559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d506421-f837-41ab-b59e-e60cf6fa1fa4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:38.627423 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3737c0-e246-4119-a2a0-105d1fb1d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:38.628087 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3737c0-e246-4119-a2a0-105d1fb1d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.628370 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3737c0-e246-4119-a2a0-105d1fb1d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.628645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3737c0-e246-4119-a2a0-105d1fb1d1c5 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.629353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3737c0-e246-4119-a2a0-105d1fb1d1c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:38.629656 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3737c0-e246-4119-a2a0-105d1fb1d1c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:38.631069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3737c0-e246-4119-a2a0-105d1fb1d1c5 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:38.642117 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 349/695] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Jul 25 09:33:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:38.643509 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:38.663336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:38.727243 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e8e6-e7ad-48db-91e0-79b94366a094 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.727570 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e8e6-e7ad-48db-91e0-79b94366a094 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.727787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e8e6-e7ad-48db-91e0-79b94366a094 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.729453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 350/696] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:38.734883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934216d7-1ba9-4310-a505-e2572183abb9 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.735326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934216d7-1ba9-4310-a505-e2572183abb9 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.735700 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934216d7-1ba9-4310-a505-e2572183abb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.752649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db2524-5854-48e9-be67-bb9ca2202681 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:38.755985 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-934216d7-1ba9-4310-a505-e2572183abb9 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:38.757258 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-934216d7-1ba9-4310-a505-e2572183abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:38.794708 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:38.796395 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.797550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.797994 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.798965 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] RBAC: Adding query filter params (interface=public, service_id=835d9afb09454267805afa1cd6bbaaff, region_id=RegionOne) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:38.799425 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:38.801027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:38.815100 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 347/697] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Jul 25 09:33:38 2022] GET /identity/v3/endpoints?service_id=835d9afb09454267805afa1cd6bbaaff&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:38.816264 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:38.858937 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 351/698] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:38.874237 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934216d7-1ba9-4310-a505-e2572183abb9 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:38.913676 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:38.933135 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c0b0-449d-4ab4-a591-69d02dca22f3 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:38.970327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbddd8-d2f8-4cfc-a451-74f00bb3c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:38.971586 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbddd8-d2f8-4cfc-a451-74f00bb3c38c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:38.972057 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbddd8-d2f8-4cfc-a451-74f00bb3c38c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:38.972541 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbddd8-d2f8-4cfc-a451-74f00bb3c38c None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:38.973912 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbddd8-d2f8-4cfc-a451-74f00bb3c38c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:38.975966 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbddd8-d2f8-4cfc-a451-74f00bb3c38c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:38.988772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 348/699] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Jul 25 09:33:38 2022] GET /identity/v3/services => generated 1002 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:33:39.008055 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934216d7-1ba9-4310-a505-e2572183abb9 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:39.012273 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:39.050645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036ee36-35d6-448f-bad7-e8a85f49b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:39.051452 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ee36-35d6-448f-bad7-e8a85f49b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.051735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ee36-35d6-448f-bad7-e8a85f49b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.052008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ee36-35d6-448f-bad7-e8a85f49b1d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.052666 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036ee36-35d6-448f-bad7-e8a85f49b1d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:39.054141 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036ee36-35d6-448f-bad7-e8a85f49b1d3 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-8036ee36-35d6-448f-bad7-e8a85f49b1d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:39.068400 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:39.069467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:39.070331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 352/700] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:38 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:39.077840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbddd8-d2f8-4cfc-a451-74f00bb3c38c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:39.172115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405c8ad-3a99-43e2-a964-2cd4c35e396d None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.172625 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405c8ad-3a99-43e2-a964-2cd4c35e396d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.172625 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405c8ad-3a99-43e2-a964-2cd4c35e396d None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.174974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 353/701] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:39.180612 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0229929-c269-4283-ae64-7bdd3a629964 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.180901 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0229929-c269-4283-ae64-7bdd3a629964 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.181174 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0229929-c269-4283-ae64-7bdd3a629964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.204079 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbddd8-d2f8-4cfc-a451-74f00bb3c38c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:39.206722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-a0229929-c269-4283-ae64-7bdd3a629964 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:39.207892 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-a0229929-c269-4283-ae64-7bdd3a629964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:39.244306 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:39.245636 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.245636 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.245636 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.246191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:39.246519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:39.247902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:39.258319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 349/702] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:39.261951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:39.281401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:39.290930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 354/703] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:39.315608 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0229929-c269-4283-ae64-7bdd3a629964 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:39.402439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a749824-df21-4174-88f2-5291d367c1f4 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:39.421459 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:39.437833 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0229929-c269-4283-ae64-7bdd3a629964 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:39.443485 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:39.444351 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.444730 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.445109 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.445915 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] RBAC: Adding query filter params (type=network) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:39.446776 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:39.448627 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:39.457708 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 350/704] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:39.463405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:39.480591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:39.481574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.481867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.482149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] PATH_INFO: `/v3/services/image` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.482999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:39.485273 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:39.500789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:39.501844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:39.502773 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 355/705] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Jul 25 09:33:39 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:39.509776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:39.548496 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:39.580762 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c37a-e8e3-4fc5-9ef9-7c19a49efaca None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:39.620173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:39.620844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.621213 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.621497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.622296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] RBAC: Adding query filter params (interface=public, service_id=c6ac6c8d944542c587cd6ecff21f65d5, region_id=RegionOne) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:39.622661 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:39.624050 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:39.630672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 351/706] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Jul 25 09:33:39 2022] GET /identity/v3/endpoints?service_id=c6ac6c8d944542c587cd6ecff21f65d5&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:39.635686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:39.644747 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32cade-2369-4019-83b0-1e743708d669 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:39.682259 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:39.683039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.683373 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.683659 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.684366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] RBAC: Adding query filter params (name=image) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:39.684677 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:39.686054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:39.692004 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 356/707] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:39.697557 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:39.718006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:39.769138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfe0a4-5743-4470-9ca6-8682b8d5be4e None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:39.811238 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208936-132d-4e24-96d7-2c242a33a826 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:39.813815 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219950b-eb2a-4f03-9fa5-eed310ca3422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:39.814669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219950b-eb2a-4f03-9fa5-eed310ca3422 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.814955 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219950b-eb2a-4f03-9fa5-eed310ca3422 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.815233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219950b-eb2a-4f03-9fa5-eed310ca3422 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.816750 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219950b-eb2a-4f03-9fa5-eed310ca3422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:39.818150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219950b-eb2a-4f03-9fa5-eed310ca3422 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:39.826823 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:39.827216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 352/708] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Jul 25 09:33:39 2022] GET /identity/v3/services => generated 1002 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:33:39.860387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559c932-0ea9-4bb8-b7dd-6bf71df3c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:39.861464 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559c932-0ea9-4bb8-b7dd-6bf71df3c217 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.861988 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559c932-0ea9-4bb8-b7dd-6bf71df3c217 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.862535 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559c932-0ea9-4bb8-b7dd-6bf71df3c217 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.863489 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559c932-0ea9-4bb8-b7dd-6bf71df3c217 None admin] RBAC: Adding query filter params (type=image) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:39.864028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559c932-0ea9-4bb8-b7dd-6bf71df3c217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:39.866154 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559c932-0ea9-4bb8-b7dd-6bf71df3c217 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:39.876806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 357/709] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:39.879256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219950b-eb2a-4f03-9fa5-eed310ca3422 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:39.943466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ec09-8a04-420a-8c41-1bb7f2e9f70f None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.943466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ec09-8a04-420a-8c41-1bb7f2e9f70f None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.943712 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444ec09-8a04-420a-8c41-1bb7f2e9f70f None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.945199 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 358/710] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:39.951033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22f22-b0e0-4bff-bdd6-e15806570fd8 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:39.951334 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22f22-b0e0-4bff-bdd6-e15806570fd8 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:39.951610 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22f22-b0e0-4bff-bdd6-e15806570fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:39.971796 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-5ce22f22-b0e0-4bff-bdd6-e15806570fd8 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:39.973075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-5ce22f22-b0e0-4bff-bdd6-e15806570fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:40.001541 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219950b-eb2a-4f03-9fa5-eed310ca3422 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:40.045903 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:40.047335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:40.047640 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:40.047924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:40.048711 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] RBAC: Adding query filter params (interface=public, service_id=4da9540c15eb4dbaaa4946240e057180, region_id=RegionOne) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:40.049092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:40.050549 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:40.061546 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 353/711] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Jul 25 09:33:39 2022] GET /identity/v3/endpoints?service_id=4da9540c15eb4dbaaa4946240e057180&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:40.062198 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:40.070539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 359/712] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:40.089438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22f22-b0e0-4bff-bdd6-e15806570fd8 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:40.106212 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:40.145933 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:40.201676 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176123b-4e03-4a5b-924a-4290c5641428 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:40.219598 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce22f22-b0e0-4bff-bdd6-e15806570fd8 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:40.245365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c11b4b-0165-4fe5-95f4-594dec00bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:40.246039 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c11b4b-0165-4fe5-95f4-594dec00bd9a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:40.246322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c11b4b-0165-4fe5-95f4-594dec00bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:40.246665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c11b4b-0165-4fe5-95f4-594dec00bd9a None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:40.247414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c11b4b-0165-4fe5-95f4-594dec00bd9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:40.248789 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c11b4b-0165-4fe5-95f4-594dec00bd9a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:40.255258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 354/713] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Jul 25 09:33:40 2022] GET /identity/v3/services => generated 1002 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:33:40.267701 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b7e9-7813-4ff2-b3ed-13f38f21c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:40.268550 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b7e9-7813-4ff2-b3ed-13f38f21c4e2 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:40.270240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b7e9-7813-4ff2-b3ed-13f38f21c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:40.270240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b7e9-7813-4ff2-b3ed-13f38f21c4e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:40.286521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09b7e9-7813-4ff2-b3ed-13f38f21c4e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-6f09b7e9-7813-4ff2-b3ed-13f38f21c4e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:33:40.292119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:40.293150 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:40.293960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 360/714] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:33:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:40.300856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c11b4b-0165-4fe5-95f4-594dec00bd9a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:40.421022 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c11b4b-0165-4fe5-95f4-594dec00bd9a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:40.454613 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:40.461631 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:40.467986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:40.467986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:40.467986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:40.467986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:40.467986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:40.467986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:40.475182 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 355/715] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:33:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:40.480534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b7e9-7813-4ff2-b3ed-13f38f21c4e2 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:40.557527 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:40.589908 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b7e9-7813-4ff2-b3ed-13f38f21c4e2 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:40.627106 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:40.628362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:40.628848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:40.629353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:40.642574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:40.644320 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:40.662521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:40.663427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:40.664301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:40.664301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:40.664301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:40.664301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:40.666534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 361/716] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:40.672430 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:40.778385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9699250-6d41-4eb7-ae4c-ec393e6acb30 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:40.816465 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:40.817477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:40.817949 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:40.818418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:40.819415 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:40.819909 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:40.821501 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:40.835474 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 356/717] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:40.841237 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:40.953801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f724eb-99e1-4e8a-b019-f66a7a53b345 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:40.977699 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:40.989921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:40.990753 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:40.991041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:41.000288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:41.000288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:41.001417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:33:41.016431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:41.017405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:41.018333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 362/718] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Jul 25 09:33:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:41.025446 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:41.085616 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:41.141666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8630c-99a0-4455-9719-0e39b5fd0028 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:41.177605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edf639-d0a4-4468-871c-06d941ab60b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:41.178273 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edf639-d0a4-4468-871c-06d941ab60b5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:41.178583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edf639-d0a4-4468-871c-06d941ab60b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:41.178862 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edf639-d0a4-4468-871c-06d941ab60b5 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:41.179809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edf639-d0a4-4468-871c-06d941ab60b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:41.180107 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edf639-d0a4-4468-871c-06d941ab60b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:41.183318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8edf639-d0a4-4468-871c-06d941ab60b5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:41.200480 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 357/719] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Jul 25 09:33:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:41.208254 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:41.318294 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d86ab-e124-4443-9ae1-987461d3e0cc None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:41.355322 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeec80c-f37c-4a51-9e0f-cce2cd941ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:41.355919 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeec80c-f37c-4a51-9e0f-cce2cd941ebe None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:41.356206 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeec80c-f37c-4a51-9e0f-cce2cd941ebe None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:41.356488 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeec80c-f37c-4a51-9e0f-cce2cd941ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:41.414958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:41.430402 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeec80c-f37c-4a51-9e0f-cce2cd941ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:41.431898 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeec80c-f37c-4a51-9e0f-cce2cd941ebe None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:41.516969 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd445-f1fe-4ec3-aeed-086cde48cfd4 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:41.517357 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd445-f1fe-4ec3-aeed-086cde48cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:41.517716 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd445-f1fe-4ec3-aeed-086cde48cfd4 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:41.519506 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 358/720] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:41.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf898-8c44-42b4-9d6b-d3b4d83b2301 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:41.525226 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf898-8c44-42b4-9d6b-d3b4d83b2301 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:41.530185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbf898-8c44-42b4-9d6b-d3b4d83b2301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:41.538579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 363/721] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:41 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 09:33:41.547513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeec80c-f37c-4a51-9e0f-cce2cd941ebe None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:41.554318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-1abbf898-8c44-42b4-9d6b-d3b4d83b2301 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:41.555612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-1abbf898-8c44-42b4-9d6b-d3b4d83b2301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:41.638904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:41.646511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 359/722] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:41.665641 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeec80c-f37c-4a51-9e0f-cce2cd941ebe None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:41.671256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbf898-8c44-42b4-9d6b-d3b4d83b2301 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:41.710015 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:41.711260 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:41.711840 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:41.712414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:41.718939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:41.725358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:41.727112 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:41.747628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:41.748595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:41.749514 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:41.749514 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:41.749514 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:41.749514 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:41.756697 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 364/723] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:41.758045 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:41.790323 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbf898-8c44-42b4-9d6b-d3b4d83b2301 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:41.834765 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:41.835728 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:41.836038 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:41.836426 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:41.837092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:41.838675 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:41.856139 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:41.857234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:41.858156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 360/724] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Jul 25 09:33:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:41.866276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:41.884100 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5344de-2d65-4e1f-8e34-aa989dea8b7d None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:41.923909 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:41.925109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:41.925682 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:41.926166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:41.927271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:41.927939 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:41.929685 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:41.931714 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:41.949251 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 365/725] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:41.951673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:41.991908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480050-2f68-4411-90d1-dac115ac1691 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:41.993724 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:42.027872 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:42.029032 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.029549 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.030048 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.031203 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:42.031789 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:42.033381 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:42.043229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 361/726] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Jul 25 09:33:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:42.044510 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:42.082680 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bed2ef-c3f0-415e-8ae1-220f213f9fa6 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:42.130998 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:42.131811 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.132102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.132383 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.143816 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:42.145341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:42.167363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:42.168556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:42.169576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 366/727] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:42.176888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:42.180249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eadf77-5172-4d4d-9307-49ad65fc399f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:42.224380 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:42.225531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.226046 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.226570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.227566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:42.228091 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:42.229753 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:42.241113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 362/728] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Jul 25 09:33:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:42.242361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:42.244789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:42.277453 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:42.291823 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21334-47c5-40ba-b1ed-b0a8f2e1448f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:42.327190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f508618-6b0b-47c9-804d-d9d8d4dba002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:42.332266 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508618-6b0b-47c9-804d-d9d8d4dba002 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.332266 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508618-6b0b-47c9-804d-d9d8d4dba002 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.332266 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508618-6b0b-47c9-804d-d9d8d4dba002 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.332266 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f508618-6b0b-47c9-804d-d9d8d4dba002 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:42.332266 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f508618-6b0b-47c9-804d-d9d8d4dba002 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:42.333975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f508618-6b0b-47c9-804d-d9d8d4dba002 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:42.351948 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 367/729] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:42.351948 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124e93-d77f-4d7a-8882-7c0ba2bd3cc1 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.351948 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124e93-d77f-4d7a-8882-7c0ba2bd3cc1 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.351948 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124e93-d77f-4d7a-8882-7c0ba2bd3cc1 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.354181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 368/730] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:42.354993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a124e93-d77f-4d7a-8882-7c0ba2bd3cc1 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:42.361742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6373d93-f6f1-416b-857e-d59e17d55fc1 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:42.396774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e13d-16c0-47a3-a5cc-1880e4228718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:42.397450 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e13d-16c0-47a3-a5cc-1880e4228718 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.397740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e13d-16c0-47a3-a5cc-1880e4228718 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.398027 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e13d-16c0-47a3-a5cc-1880e4228718 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.398836 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8e13d-16c0-47a3-a5cc-1880e4228718 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:42.400303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8e13d-16c0-47a3-a5cc-1880e4228718 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:42.463279 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a124e93-d77f-4d7a-8882-7c0ba2bd3cc1 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:42.479650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:42.490203 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 363/731] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:33:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:33:42.492087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3efb1-40ad-475a-b3d4-156cb400f997 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.492468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3efb1-40ad-475a-b3d4-156cb400f997 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.492754 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3efb1-40ad-475a-b3d4-156cb400f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.518856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-55e3efb1-40ad-475a-b3d4-156cb400f997 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:42.520570 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-55e3efb1-40ad-475a-b3d4-156cb400f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:42.521259 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc11c53-41a2-4ad2-b3e2-93579fa576b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:42.521950 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc11c53-41a2-4ad2-b3e2-93579fa576b2 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.522240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc11c53-41a2-4ad2-b3e2-93579fa576b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.522554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc11c53-41a2-4ad2-b3e2-93579fa576b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.523425 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc11c53-41a2-4ad2-b3e2-93579fa576b2 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=3d3ad9c9521e42f783693c1c4b20cadc) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:42.523745 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc11c53-41a2-4ad2-b3e2-93579fa576b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:42.526570 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc11c53-41a2-4ad2-b3e2-93579fa576b2 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:42.542518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 369/732] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:33:42 2022] GET /identity/v3/role_assignments?user.id=3d3ad9c9521e42f783693c1c4b20cadc&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=bd8b88fae376413398183761500b2e1d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:42.633012 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 364/733] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:42.636293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98bbe-09e9-4b16-b13f-964a1af4cb7b None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.638943 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98bbe-09e9-4b16-b13f-964a1af4cb7b None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.638943 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98bbe-09e9-4b16-b13f-964a1af4cb7b None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.638943 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 370/734] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:42.645308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba65e2-c274-44be-93c6-8dee7d42f4c6 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.645619 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba65e2-c274-44be-93c6-8dee7d42f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.645875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba65e2-c274-44be-93c6-8dee7d42f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.660713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b98bbe-09e9-4b16-b13f-964a1af4cb7b None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:42.670502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-d2ba65e2-c274-44be-93c6-8dee7d42f4c6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:42.670502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-d2ba65e2-c274-44be-93c6-8dee7d42f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:42.682403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:42.766922 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 365/735] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:42.790740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba65e2-c274-44be-93c6-8dee7d42f4c6 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:42.805356 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b98bbe-09e9-4b16-b13f-964a1af4cb7b None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:42.847058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:42.848192 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.848686 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.849155 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] PATH_INFO: `/v3/services/network` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.850152 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:42.851853 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:42.867589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:42.868735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:42.869596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 371/736] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:42 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:42.875412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:42.919044 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:42.930068 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba65e2-c274-44be-93c6-8dee7d42f4c6 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:42.978411 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:42.979258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:42.979540 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:42.979813 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] PATH_INFO: `/v3/services/image` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:42.980466 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:42.981832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:42.994934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120614b6-f841-4a5c-b77f-fe6cc7729087 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:42.997850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:42.998857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 09:33:43.000322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:43.007885 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 366/737] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Jul 25 09:33:42 2022] GET /identity/v3/services/image => generated 86 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:43.008990 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:43.023537 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:43.034845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:43.038142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:43.038142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:43.038142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:43.038142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] RBAC: Adding query filter params (name=network) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:43.038142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:43.038755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:43.044190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 372/738] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:43.050455 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:43.127750 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc6093-2ef8-453a-b2e9-eb349fd9114a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:43.173119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:43.173119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:43.173119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:43.173119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:43.173849 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] RBAC: Adding query filter params (name=image) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:43.174168 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:43.176300 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:43.183105 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 367/739] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:43.185339 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878f2de-60cd-46af-969e-73ca02310b7e None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:43.188607 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:43.189313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:43.226888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:43.227558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:43.227834 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:43.228120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:43.228818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] RBAC: Adding query filter params (type=network) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:43.229127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:43.230514 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:43.236645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 373/740] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:43.242649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:43.298838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:43.327299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815947b-05c4-4319-8a2e-7f8502650ef9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:43.371848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:43.372565 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:43.372853 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:43.373129 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:43.373984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] RBAC: Adding query filter params (type=image) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:43.374174 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:43.376338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:43.386304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 368/741] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:43.387305 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:43.400998 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048211-c45f-4ea3-9389-dc98642ad128 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:43.441063 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbfcb9-7f23-41b4-985d-cd261bf1da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:43.441300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbfcb9-7f23-41b4-985d-cd261bf1da62 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:43.441543 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbfcb9-7f23-41b4-985d-cd261bf1da62 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:43.441809 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbfcb9-7f23-41b4-985d-cd261bf1da62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:43.442586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbfcb9-7f23-41b4-985d-cd261bf1da62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:43.443964 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbfcb9-7f23-41b4-985d-cd261bf1da62 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:43.514943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9989a23-e41f-4def-913d-b46437c7340d None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:43.523081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 374/742] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:33:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:33:43.571749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb49694-e9f4-458f-a459-8cb12e6fb42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:43.572766 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49694-e9f4-458f-a459-8cb12e6fb42e None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:43.573214 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49694-e9f4-458f-a459-8cb12e6fb42e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:43.573714 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49694-e9f4-458f-a459-8cb12e6fb42e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:43.574679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb49694-e9f4-458f-a459-8cb12e6fb42e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:43.576886 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb49694-e9f4-458f-a459-8cb12e6fb42e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:43.582784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:43.691936 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 369/743] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:33:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:33:44.960491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c8c6-dc45-4e78-b429-6ebbdfbbaa7d None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:44.961016 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c8c6-dc45-4e78-b429-6ebbdfbbaa7d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:44.961016 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c8c6-dc45-4e78-b429-6ebbdfbbaa7d None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:44.966060 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 375/744] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:44.966212 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a405-2d8f-4ee8-83a6-3c7e88089bf2 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:44.966212 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a405-2d8f-4ee8-83a6-3c7e88089bf2 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:44.966212 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a405-2d8f-4ee8-83a6-3c7e88089bf2 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:44.967474 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 370/745] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:44.967606 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c18b4-6731-493e-a267-5c8d0ba9ce82 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:44.967802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c18b4-6731-493e-a267-5c8d0ba9ce82 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:44.968120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c18b4-6731-493e-a267-5c8d0ba9ce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:44.973185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7cdb7-dac0-4679-afec-8e07aa28ee2e None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:44.973671 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7cdb7-dac0-4679-afec-8e07aa28ee2e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:44.974162 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7cdb7-dac0-4679-afec-8e07aa28ee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:44.987480 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-000c18b4-6731-493e-a267-5c8d0ba9ce82 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:44.988675 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-000c18b4-6731-493e-a267-5c8d0ba9ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:44.993590 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-7ba7cdb7-dac0-4679-afec-8e07aa28ee2e None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:44.994984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-7ba7cdb7-dac0-4679-afec-8e07aa28ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:45.006701 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:45.070653 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 376/746] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:44 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:45.082512 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 371/747] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:44 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:45.094913 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c18b4-6731-493e-a267-5c8d0ba9ce82 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:45.104479 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7cdb7-dac0-4679-afec-8e07aa28ee2e None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:45.203072 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c18b4-6731-493e-a267-5c8d0ba9ce82 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:45.222930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7cdb7-dac0-4679-afec-8e07aa28ee2e None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:45.239104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58063410-0622-4905-ae41-253293b925dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:45.239923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063410-0622-4905-ae41-253293b925dd None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:45.240215 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063410-0622-4905-ae41-253293b925dd None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:45.240484 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063410-0622-4905-ae41-253293b925dd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:45.241148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58063410-0622-4905-ae41-253293b925dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:45.242564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58063410-0622-4905-ae41-253293b925dd None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:45.247851 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-58063410-0622-4905-ae41-253293b925dd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:45.255092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:45.260483 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:45.261506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 377/748] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Jul 25 09:33:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:45.262524 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58063410-0622-4905-ae41-253293b925dd None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:45.265280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:45.266539 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:45.266986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:45.267408 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:45.268204 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:45.269732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:45.281672 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:45.288176 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:45.289350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:45.290508 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 372/749] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:45.295379 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:45.378617 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58063410-0622-4905-ae41-253293b925dd None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:45.408830 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfce6e1-62bb-4915-857a-cf12472bd6e9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:45.417588 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:45.418276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:45.418598 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:45.418873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:45.419578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:45.419885 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:45.421323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:45.427300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 378/750] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Jul 25 09:33:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:45.432843 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:45.451839 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:45.452584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:45.454649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:45.454649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:45.454649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:45.454649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:45.455713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:45.461898 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 373/751] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:45.467161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:45.521416 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:45.526766 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:45.552065 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851eaaf-38a0-4dad-8183-5733e022d2d9 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:45.582127 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d03c-6ad2-40ef-81db-750419d16fe5 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:45.587295 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586c589-4bae-4b52-bf31-376bb0a52b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:45.587964 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586c589-4bae-4b52-bf31-376bb0a52b67 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:45.588248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586c589-4bae-4b52-bf31-376bb0a52b67 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:45.588524 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586c589-4bae-4b52-bf31-376bb0a52b67 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:45.589228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586c589-4bae-4b52-bf31-376bb0a52b67 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:45.589538 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586c589-4bae-4b52-bf31-376bb0a52b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:45.590953 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586c589-4bae-4b52-bf31-376bb0a52b67 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:45.596905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 379/752] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Jul 25 09:33:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:45.628938 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2436e5a-ac6b-46ce-bdd0-53aff87fae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:45.629634 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2436e5a-ac6b-46ce-bdd0-53aff87fae0f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:45.629998 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2436e5a-ac6b-46ce-bdd0-53aff87fae0f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:45.630269 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2436e5a-ac6b-46ce-bdd0-53aff87fae0f None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:45.631036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2436e5a-ac6b-46ce-bdd0-53aff87fae0f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:45.631351 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2436e5a-ac6b-46ce-bdd0-53aff87fae0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:45.632774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2436e5a-ac6b-46ce-bdd0-53aff87fae0f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:45.638581 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 374/753] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:45.976676 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781377f-ea5c-4a11-a760-89f917bb63d4 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:45.977173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781377f-ea5c-4a11-a760-89f917bb63d4 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:45.977173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781377f-ea5c-4a11-a760-89f917bb63d4 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:45.978532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 380/754] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:45.984499 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d16c-07d7-496a-80e7-4f555d225581 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:45.984922 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d16c-07d7-496a-80e7-4f555d225581 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:45.985135 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469d16c-07d7-496a-80e7-4f555d225581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:46.003533 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-3469d16c-07d7-496a-80e7-4f555d225581 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:46.004721 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-3469d16c-07d7-496a-80e7-4f555d225581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:46.075814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 375/755] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:45 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:46.099053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781377f-ea5c-4a11-a760-89f917bb63d4 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:46.205326 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781377f-ea5c-4a11-a760-89f917bb63d4 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:46.241206 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb861-b9f2-4410-a815-6e59de236ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:46.241778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb861-b9f2-4410-a815-6e59de236ece None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:46.242062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb861-b9f2-4410-a815-6e59de236ece None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:46.242340 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fb861-b9f2-4410-a815-6e59de236ece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:46.253817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:46.317553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fb861-b9f2-4410-a815-6e59de236ece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:46.319054 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fb861-b9f2-4410-a815-6e59de236ece None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:46.423027 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 381/756] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:33:46 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 09:33:46.429096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469d16c-07d7-496a-80e7-4f555d225581 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:46.472801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:46.528333 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469d16c-07d7-496a-80e7-4f555d225581 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:46.562436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe141c0e-e293-426a-92f4-4c3ef67003b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:46.563249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141c0e-e293-426a-92f4-4c3ef67003b7 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:46.563536 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141c0e-e293-426a-92f4-4c3ef67003b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:46.563816 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe141c0e-e293-426a-92f4-4c3ef67003b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:46.573785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe141c0e-e293-426a-92f4-4c3ef67003b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:46.575281 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe141c0e-e293-426a-92f4-4c3ef67003b7 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-fe141c0e-e293-426a-92f4-4c3ef67003b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:33:46.594865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:46.596136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:46.597033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:33:46.597033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:33:46.597033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:33:46.597033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:46.597033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 376/757] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:46.603217 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb861-b9f2-4410-a815-6e59de236ece None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:46.645785 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:46.704231 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fb861-b9f2-4410-a815-6e59de236ece None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:46.739671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca6ff8-ab03-4d95-b34f-85bd793823f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:46.740356 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca6ff8-ab03-4d95-b34f-85bd793823f4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:46.740644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca6ff8-ab03-4d95-b34f-85bd793823f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:46.740924 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca6ff8-ab03-4d95-b34f-85bd793823f4 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:46.741668 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca6ff8-ab03-4d95-b34f-85bd793823f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:46.741982 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca6ff8-ab03-4d95-b34f-85bd793823f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:46.743445 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca6ff8-ab03-4d95-b34f-85bd793823f4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:46.762504 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 382/758] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:47.866402 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33892113-989e-451e-a629-a63063687025 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:47.866957 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33892113-989e-451e-a629-a63063687025 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:47.866957 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33892113-989e-451e-a629-a63063687025 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:47.868326 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 377/759] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:47.873475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15085-d363-4c5b-8a5a-597a2f0db0b1 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:47.873903 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15085-d363-4c5b-8a5a-597a2f0db0b1 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:47.874173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c15085-d363-4c5b-8a5a-597a2f0db0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:47.892778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-f9c15085-d363-4c5b-8a5a-597a2f0db0b1 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:47.893966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-f9c15085-d363-4c5b-8a5a-597a2f0db0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:47.936597 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcab8-9ae8-49dc-b887-1ec2299c51ed None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:47.936974 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcab8-9ae8-49dc-b887-1ec2299c51ed None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:47.937247 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dcab8-9ae8-49dc-b887-1ec2299c51ed None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:47.938720 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 378/760] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:47.943729 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d119e8-7754-4f33-8284-0a20aa1f56e9 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:47.944062 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d119e8-7754-4f33-8284-0a20aa1f56e9 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:47.944344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d119e8-7754-4f33-8284-0a20aa1f56e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:47.961303 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 383/761] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:47 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:47.963010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-d6d119e8-7754-4f33-8284-0a20aa1f56e9 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:47.964210 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-d6d119e8-7754-4f33-8284-0a20aa1f56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:47.986362 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15085-d363-4c5b-8a5a-597a2f0db0b1 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:48.016853 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:48.033264 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 379/762] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:47 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:48.057111 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d119e8-7754-4f33-8284-0a20aa1f56e9 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:48.081982 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:48.088124 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c15085-d363-4c5b-8a5a-597a2f0db0b1 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:48.123035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467b5b2-343d-48c2-847b-ca3a6cf5ef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:48.123643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467b5b2-343d-48c2-847b-ca3a6cf5ef86 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:48.123929 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467b5b2-343d-48c2-847b-ca3a6cf5ef86 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:48.124223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467b5b2-343d-48c2-847b-ca3a6cf5ef86 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:48.125024 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467b5b2-343d-48c2-847b-ca3a6cf5ef86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:48.126435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467b5b2-343d-48c2-847b-ca3a6cf5ef86 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:48.157014 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d119e8-7754-4f33-8284-0a20aa1f56e9 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:48.189924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b41ef-be98-4732-8d28-bf351cc86621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:48.190604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b41ef-be98-4732-8d28-bf351cc86621 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:48.190889 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b41ef-be98-4732-8d28-bf351cc86621 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:48.191202 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b41ef-be98-4732-8d28-bf351cc86621 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:48.191950 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b41ef-be98-4732-8d28-bf351cc86621 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:48.193306 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b41ef-be98-4732-8d28-bf351cc86621 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:48.225920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 384/763] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:33:47 2022] POST /identity/v3/services => generated 269 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:33:48.319055 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 380/764] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:33:48 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:33:50.488740 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cf09c-1a26-4e12-b8e9-656f14a30b80 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:50.489308 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cf09c-1a26-4e12-b8e9-656f14a30b80 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:50.489308 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cf09c-1a26-4e12-b8e9-656f14a30b80 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:50.490805 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 385/765] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:50.496195 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782185c9-16e6-4af9-93f4-8d1e7512fa7f None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:50.496623 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782185c9-16e6-4af9-93f4-8d1e7512fa7f None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:50.496767 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782185c9-16e6-4af9-93f4-8d1e7512fa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:50.519324 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-782185c9-16e6-4af9-93f4-8d1e7512fa7f None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:50.519324 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-782185c9-16e6-4af9-93f4-8d1e7512fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:50.566417 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf3929-76eb-4200-8da6-c79bebe42706 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:50.566730 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf3929-76eb-4200-8da6-c79bebe42706 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:50.567019 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf3929-76eb-4200-8da6-c79bebe42706 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:50.568367 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 386/766] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:50.573234 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6873b6-f3eb-446f-a89d-8a9be4e3f9d7 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:50.573611 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6873b6-f3eb-446f-a89d-8a9be4e3f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:50.573896 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6873b6-f3eb-446f-a89d-8a9be4e3f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:50.593317 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-bc6873b6-f3eb-446f-a89d-8a9be4e3f9d7 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:50.593605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 381/767] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:50.594562 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-bc6873b6-f3eb-446f-a89d-8a9be4e3f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:50.617339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782185c9-16e6-4af9-93f4-8d1e7512fa7f None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:50.629393 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:50.664236 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 387/768] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:50.688356 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6873b6-f3eb-446f-a89d-8a9be4e3f9d7 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:50.709599 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:50.717588 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782185c9-16e6-4af9-93f4-8d1e7512fa7f None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:50.753279 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:50.754113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:50.754399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:50.754719 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:50.755408 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:50.756825 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:50.769869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:50.770807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:50.771893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 382/769] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Jul 25 09:33:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:50.777043 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:50.788814 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6873b6-f3eb-446f-a89d-8a9be4e3f9d7 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:50.823201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:50.823983 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:50.824413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:50.824824 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:50.825836 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:50.828599 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:50.840975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:50.841967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:50.843066 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 388/770] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:50.852561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:50.854450 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:50.880315 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea974-8b29-4683-ba2c-ac063983713c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:50.914124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:50.914819 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:50.915111 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:50.915392 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:50.916143 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:50.916454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:50.917839 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:50.923193 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 383/771] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Jul 25 09:33:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:50.928826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:50.938178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:50.954127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df37c-c0a8-4838-b0dc-ddd38c1c4dce None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:50.989065 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:50.989730 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:50.990117 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:50.990292 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:50.991028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:50.991342 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:50.992741 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:50.997697 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 389/772] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:51.003849 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:51.031218 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a682bb-93bc-40e0-884b-559261dd7bf6 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:51.068412 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:51.069180 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:51.069506 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:51.069785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:51.070568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:51.070880 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:51.072276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:51.082239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 384/773] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Jul 25 09:33:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:51.083300 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:51.085971 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:51.104805 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8b958-7cdd-473a-bdfe-2ec0fb3d3a20 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:51.139390 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:51.140125 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:51.140407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:51.140685 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:51.141387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:51.141697 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:51.143128 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:51.147883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 390/774] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:51.153823 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:51.168002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:51.183785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9722139-978d-4abf-bc19-b611013cdbaf None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:51.219196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:51.219874 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:51.220162 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:51.220441 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:51.221228 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] RBAC: Adding query filter params (interface=public, service_id=a96a83b73c3744b0b1c6ac11b1375127, region_id=RegionOne) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:51.221543 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:51.222964 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:51.228187 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 385/775] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Jul 25 09:33:51 2022] GET /identity/v3/endpoints?service_id=a96a83b73c3744b0b1c6ac11b1375127&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:51.234242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:51.257698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ee849-0be3-4b03-8285-09053efdce07 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:51.292463 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:51.293124 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:51.293411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:51.293692 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:51.294512 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] RBAC: Adding query filter params (interface=public, service_id=ced76958b72a464dac848365d29bc4c3, region_id=RegionOne) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:51.294828 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:51.296225 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:51.301628 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:51.303528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 391/776] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Jul 25 09:33:51 2022] GET /identity/v3/endpoints?service_id=ced76958b72a464dac848365d29bc4c3&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:51.309121 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:51.337993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae84d3e-4593-4b56-8b33-5b2cc17ac365 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:51.371772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69633d-05c2-4784-b223-f9acd9665a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:51.372374 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69633d-05c2-4784-b223-f9acd9665a9f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:51.372658 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69633d-05c2-4784-b223-f9acd9665a9f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:51.372963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69633d-05c2-4784-b223-f9acd9665a9f None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:51.373643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69633d-05c2-4784-b223-f9acd9665a9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:51.375554 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69633d-05c2-4784-b223-f9acd9665a9f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:51.381414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 386/777] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Jul 25 09:33:51 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:33:51.388085 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:51.412964 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ad9ae-6a46-4ed0-b789-d3cad0fbab1c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:51.450333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db13758-a4e4-4c6c-875e-c7c0afb0ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:51.451073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13758-a4e4-4c6c-875e-c7c0afb0ed0d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:51.451364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13758-a4e4-4c6c-875e-c7c0afb0ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:51.451648 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db13758-a4e4-4c6c-875e-c7c0afb0ed0d None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:51.452408 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db13758-a4e4-4c6c-875e-c7c0afb0ed0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:51.454360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db13758-a4e4-4c6c-875e-c7c0afb0ed0d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:51.470503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 392/778] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Jul 25 09:33:51 2022] GET /identity/v3/services => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:33:53.617760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777110a-3305-4137-bdb2-711f6c497c9a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:53.618301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777110a-3305-4137-bdb2-711f6c497c9a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:53.618301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777110a-3305-4137-bdb2-711f6c497c9a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:53.619615 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 387/779] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:53.625206 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b7e6d-5622-4d4d-a169-2899818e22d3 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:53.625619 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b7e6d-5622-4d4d-a169-2899818e22d3 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:53.625846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b7e6d-5622-4d4d-a169-2899818e22d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:53.644478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-5e8b7e6d-5622-4d4d-a169-2899818e22d3 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:53.645673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-5e8b7e6d-5622-4d4d-a169-2899818e22d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:53.704878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5876b-afa9-4bf2-9925-55782156a15b None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:53.705252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5876b-afa9-4bf2-9925-55782156a15b None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:53.705541 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5876b-afa9-4bf2-9925-55782156a15b None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:53.707190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 388/780] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:53.711952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59713594-6425-42d4-a1eb-0ee89808d65a None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:53.712248 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59713594-6425-42d4-a1eb-0ee89808d65a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:53.712529 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59713594-6425-42d4-a1eb-0ee89808d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:53.714015 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 393/781] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:53.731363 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-59713594-6425-42d4-a1eb-0ee89808d65a None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:53.732553 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-59713594-6425-42d4-a1eb-0ee89808d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:53.737585 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b7e6d-5622-4d4d-a169-2899818e22d3 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:53.799387 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 389/782] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:53.807365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:53.824036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59713594-6425-42d4-a1eb-0ee89808d65a None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:53.838070 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b7e6d-5622-4d4d-a169-2899818e22d3 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:53.872842 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:53.873611 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:53.873898 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:53.874747 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:53.875392 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:53.876845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:53.881998 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:53.889102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:53.892369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:53.893276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 394/783] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Jul 25 09:33:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:53.896620 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:53.923413 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59713594-6425-42d4-a1eb-0ee89808d65a None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:53.958798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:53.959599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:53.959889 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:53.960170 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:53.960824 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:53.962200 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:53.973991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:53.975000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:33:53.976320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 390/784] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:53.981010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:54.000145 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf3814-b522-4cf0-8f63-99ae8596eda7 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:54.033860 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:54.034555 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:54.034846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:54.035127 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:54.035830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:54.036142 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:54.037521 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:54.038640 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:54.043241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 395/785] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Jul 25 09:33:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:54.052289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:54.087410 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba3b3-a9be-46f5-9a1b-371e9f5b2ba9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:54.112030 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:54.124787 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:54.124787 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:54.125033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:54.125304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:54.126009 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:54.126328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:54.127774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:54.132455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 391/786] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:54.138074 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:54.149277 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741e18f-6ce7-4b12-b827-6a7fcd0ad00a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:54.184108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:54.184774 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:54.185056 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:54.185332 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:54.186028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:54.186335 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:54.188377 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:54.193129 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 396/787] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Jul 25 09:33:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:54.199411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:54.238327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10776d40-834c-4967-8bfe-e501452216a6 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:54.261985 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:54.275834 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:54.276507 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:54.276793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:54.277068 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:54.277784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:54.278095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:54.279518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:54.284675 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 392/788] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Jul 25 09:33:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:54.290274 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:54.300395 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616873ba-0dee-470a-974a-d593932ebc36 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:54.336859 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c063f32-5da8-4d6e-94d8-094a693ed136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:54.337532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063f32-5da8-4d6e-94d8-094a693ed136 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:54.337820 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063f32-5da8-4d6e-94d8-094a693ed136 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:54.338100 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c063f32-5da8-4d6e-94d8-094a693ed136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:54.338903 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c063f32-5da8-4d6e-94d8-094a693ed136 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:54.340282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c063f32-5da8-4d6e-94d8-094a693ed136 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:54.343337 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:54.388944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd5f0-a7b7-4939-a864-0ec5fb933225 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:54.421755 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b20e8-f040-40b2-aff3-f2be46750c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:54.422405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b20e8-f040-40b2-aff3-f2be46750c86 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:54.422722 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b20e8-f040-40b2-aff3-f2be46750c86 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:54.423004 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b20e8-f040-40b2-aff3-f2be46750c86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:54.424400 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b20e8-f040-40b2-aff3-f2be46750c86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:54.425080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b20e8-f040-40b2-aff3-f2be46750c86 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:54.438424 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 397/789] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:33:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:33:54.529582 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 393/790] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:33:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:33:56.737790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3ceb-75a6-4c74-895c-e76a23f0ef7b None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:56.738324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3ceb-75a6-4c74-895c-e76a23f0ef7b None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:56.738324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3ceb-75a6-4c74-895c-e76a23f0ef7b None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:56.739883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 398/791] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:56.745596 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f822fa-7e14-4a89-b988-8991a5e86c9e None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:56.746112 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f822fa-7e14-4a89-b988-8991a5e86c9e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:56.746235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f822fa-7e14-4a89-b988-8991a5e86c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:56.765660 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-39f822fa-7e14-4a89-b988-8991a5e86c9e None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:56.766991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-39f822fa-7e14-4a89-b988-8991a5e86c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:56.839449 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 394/792] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:56 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:56.862437 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff3ceb-75a6-4c74-895c-e76a23f0ef7b None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:56.903913 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435108-2ad0-4d65-aa2b-9e9333142b7c None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:56.904200 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435108-2ad0-4d65-aa2b-9e9333142b7c None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:56.904478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435108-2ad0-4d65-aa2b-9e9333142b7c None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:56.906484 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 395/793] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:56.911424 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dafda5-fb00-4485-ba5e-eba3540ccc19 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:56.911736 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dafda5-fb00-4485-ba5e-eba3540ccc19 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:56.912015 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dafda5-fb00-4485-ba5e-eba3540ccc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:56.929360 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-a3dafda5-fb00-4485-ba5e-eba3540ccc19 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:56.930564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-a3dafda5-fb00-4485-ba5e-eba3540ccc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:56.958606 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:56.967006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff3ceb-75a6-4c74-895c-e76a23f0ef7b None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:56.985418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:57.000200 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 396/794] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:56 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:57.002244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:57.003074 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:57.003374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:57.003643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] PATH_INFO: `/v3/services/compute` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:57.004301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:57.005675 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:57.017963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:57.019043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.019920 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 399/795] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:33:57.025077 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:57.025193 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dafda5-fb00-4485-ba5e-eba3540ccc19 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:57.124363 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dafda5-fb00-4485-ba5e-eba3540ccc19 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:57.125364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc19abc-c5e5-479d-be42-7acb8a0a0a9c None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:57.160128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:57.160351 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:57.160792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:57.160905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:57.161077 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:57.161198 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:57.161350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:57.161452 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:57.162042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:57.162145 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:57.162346 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:57.163569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:57.163755 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:57.166179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING keystone.server.flask.common [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 09:33:57.168420 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 397/796] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:57.174147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:57.202216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:57.219738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.sql.core [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 09:33:57.219738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 09:33:57.219738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [parameters: {'id': 'b08e98402e3d40b1b009244539622eb0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 09:33:57.219738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93888) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b08e98402e3d40b1b009244539622eb0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b08e98402e3d40b1b009244539622eb0. Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application conn.query(q) Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 09:33:57.236911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result.read() Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 09:33:57.237780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application next(self.gen) Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application yield resource Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application next(self.gen) Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise self.value Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application session.commit() Jul 25 09:33:57.238801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.session.flush() Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application compat.raise_( Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 09:33:57.239695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 09:33:57.240593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application conn.query(q) Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result.read() Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 09:33:57.241418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [parameters: {'id': 'b08e98402e3d40b1b009244539622eb0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:57.242353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:57.243169 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b08e98402e3d40b1b009244539622eb0. Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.244053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 400/797] 10.222.0.67 () {60 vars in 1140 bytes} [Mon Jul 25 09:33:57 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:57.244595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:57.275808 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9578-c772-4714-b418-1c93826d39c6 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:57.289592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:57.312383 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:57.313059 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:57.313353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:57.313635 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:57.314375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:57.314736 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:57.316106 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:57.320573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 398/798] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:33:57.353402 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c03293-adea-4aca-a515-ebc8ebec063a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:57.391186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2398260-bfe2-4202-a8b3-5fd8a1f9dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:57.392004 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2398260-bfe2-4202-a8b3-5fd8a1f9dad1 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:57.392294 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2398260-bfe2-4202-a8b3-5fd8a1f9dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:57.392576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2398260-bfe2-4202-a8b3-5fd8a1f9dad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:57.400075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2398260-bfe2-4202-a8b3-5fd8a1f9dad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:57.401780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2398260-bfe2-4202-a8b3-5fd8a1f9dad1 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-c2398260-bfe2-4202-a8b3-5fd8a1f9dad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:33:57.417002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:33:57.417956 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:33:57.419058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 401/799] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:33:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:33:57.425050 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:57.519472 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:57.533427 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99596e-7c0a-4027-be9b-5c5f542d4489 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:57.564316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8af72-b564-444e-a1a5-a78094660ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:57.564981 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8af72-b564-444e-a1a5-a78094660ece None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:57.565366 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8af72-b564-444e-a1a5-a78094660ece None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:57.565609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8af72-b564-444e-a1a5-a78094660ece None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:57.566358 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8af72-b564-444e-a1a5-a78094660ece None admin] RBAC: Adding query filter params (name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:33:57.566700 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8af72-b564-444e-a1a5-a78094660ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:57.568140 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8af72-b564-444e-a1a5-a78094660ece None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:57.585836 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 399/800] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:33:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:33:59.573365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beffc8-0311-483e-b84d-24d3e71cb050 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:59.573887 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beffc8-0311-483e-b84d-24d3e71cb050 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:59.574000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beffc8-0311-483e-b84d-24d3e71cb050 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:59.578230 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 402/801] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:33:59.583887 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73a232-4615-4a2c-af8f-71b309698263 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:59.584301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73a232-4615-4a2c-af8f-71b309698263 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:59.584404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73a232-4615-4a2c-af8f-71b309698263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:59.603092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-cf73a232-4615-4a2c-af8f-71b309698263 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:59.604262 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-cf73a232-4615-4a2c-af8f-71b309698263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:59.668970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 400/802] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:59 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:33:59.692743 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beffc8-0311-483e-b84d-24d3e71cb050 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:33:59.795531 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:33:59.801073 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beffc8-0311-483e-b84d-24d3e71cb050 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:33:59.835928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02930f17-4808-4857-9e53-b088bc590c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:33:59.836518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02930f17-4808-4857-9e53-b088bc590c19 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:59.836800 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02930f17-4808-4857-9e53-b088bc590c19 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:59.837083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02930f17-4808-4857-9e53-b088bc590c19 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:59.837819 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02930f17-4808-4857-9e53-b088bc590c19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:33:59.839263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02930f17-4808-4857-9e53-b088bc590c19 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:33:59.858689 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532010-5082-4a60-bad6-c0627787b962 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:59.859069 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532010-5082-4a60-bad6-c0627787b962 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:59.859391 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532010-5082-4a60-bad6-c0627787b962 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:59.860755 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 401/803] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:33:59.865472 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86450-a390-4b56-8002-3317b1d60101 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:33:59.865762 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86450-a390-4b56-8002-3317b1d60101 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:33:59.866047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86450-a390-4b56-8002-3317b1d60101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:33:59.884170 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-7ea86450-a390-4b56-8002-3317b1d60101 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:33:59.885360 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-7ea86450-a390-4b56-8002-3317b1d60101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:33:59.921432 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 403/804] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:33:59 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:33:59.963403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 402/805] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:33:59 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:33:59.990366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02930f17-4808-4857-9e53-b088bc590c19 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:00.098497 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02930f17-4808-4857-9e53-b088bc590c19 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:00.133047 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:00.133724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:00.134011 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:00.134293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:00.135053 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:00.136511 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:00.195068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.sql.core [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 09:34:00.195068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 09:34:00.195068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [parameters: {'user_id': '4bb5f99ea82f46bba57aa32e8927e740', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 09:34:00.195068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93888) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application conn.query(q) Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result.read() Jul 25 09:34:00.202375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 09:34:00.203284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application next(self.gen) Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application yield resource Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application next(self.gen) Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise self.value Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application session.commit() Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 09:34:00.204256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.session.flush() Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application compat.raise_( Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 09:34:00.205148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 09:34:00.206290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application conn.query(q) Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application result.read() Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 09:34:00.207159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [parameters: {'user_id': '4bb5f99ea82f46bba57aa32e8927e740', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:34:00.207986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 09:34:00.208818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 09:34:00.209763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 09:34:00.209763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 09:34:00.209763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 09:34:00.209763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 09:34:00.209763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 09:34:00.209763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:34:00.209763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 404/806] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Jul 25 09:33:59 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:34:00.216149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea86450-a390-4b56-8002-3317b1d60101 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:00.226970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:00.317866 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea86450-a390-4b56-8002-3317b1d60101 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:00.354792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83016b-9cb1-43dd-b3ba-09acdbb3e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:00.355464 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83016b-9cb1-43dd-b3ba-09acdbb3e056 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:00.355754 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83016b-9cb1-43dd-b3ba-09acdbb3e056 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:00.356032 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83016b-9cb1-43dd-b3ba-09acdbb3e056 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:00.363876 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83016b-9cb1-43dd-b3ba-09acdbb3e056 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:00.365328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83016b-9cb1-43dd-b3ba-09acdbb3e056 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1e83016b-9cb1-43dd-b3ba-09acdbb3e056 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:34:00.380047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:34:00.381124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:34:00.382108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 403/807] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:34:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:34:00.387516 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:00.412529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:00.495237 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a94c6-bf9e-4143-b750-1e04ded6c911 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:00.530634 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393add5-0a50-4282-9af1-2585a8509370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:00.531453 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393add5-0a50-4282-9af1-2585a8509370 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:00.531735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393add5-0a50-4282-9af1-2585a8509370 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:00.532008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393add5-0a50-4282-9af1-2585a8509370 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:00.532806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393add5-0a50-4282-9af1-2585a8509370 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:34:00.533110 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393add5-0a50-4282-9af1-2585a8509370 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:00.534743 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393add5-0a50-4282-9af1-2585a8509370 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:00.573436 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 405/808] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Jul 25 09:34:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:34:02.176395 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6de8-b39e-4529-a44f-9a9b8429e0f9 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:02.176922 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6de8-b39e-4529-a44f-9a9b8429e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:02.177042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6de8-b39e-4529-a44f-9a9b8429e0f9 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:02.178327 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 404/809] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:34:02.183618 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b5714-a91f-4573-b737-4fc8533ad75c None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:02.184045 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b5714-a91f-4573-b737-4fc8533ad75c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:02.184185 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b5714-a91f-4573-b737-4fc8533ad75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:02.202799 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-885b5714-a91f-4573-b737-4fc8533ad75c None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:34:02.204284 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-885b5714-a91f-4573-b737-4fc8533ad75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:34:02.268664 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 406/810] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:34:02 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:34:02.291677 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f6de8-b39e-4529-a44f-9a9b8429e0f9 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:02.358150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:02.391825 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f6de8-b39e-4529-a44f-9a9b8429e0f9 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:02.425093 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:02.425880 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:02.426167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:02.426533 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:02.427125 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:02.428517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:34:02.440726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:34:02.441888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:34:02.442875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 405/811] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:34:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:34:02.447809 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b5714-a91f-4573-b737-4fc8533ad75c None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:02.458260 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:02.545494 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b5714-a91f-4573-b737-4fc8533ad75c None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:02.579334 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:02.579986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:02.580276 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:02.580556 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:02.581550 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:34:02.581861 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:02.583269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:02.588081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 407/812] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:34:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:34:02.594369 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:02.693993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f17a76-0840-4f4f-a203-deb2b28bf600 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:02.722926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:02.727683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:02.728411 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:02.728694 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:02.728975 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:02.729682 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:34:02.734902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:02.734902 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:02.736713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 406/813] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:34:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:34:02.742625 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:02.810427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:02.840020 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afea3b-f47a-4c8b-9123-c395bd1b9317 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:02.873496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cb6c6-3eab-4721-839b-6f2c30c9f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:02.874355 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cb6c6-3eab-4721-839b-6f2c30c9f990 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:02.874668 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cb6c6-3eab-4721-839b-6f2c30c9f990 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:02.874947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cb6c6-3eab-4721-839b-6f2c30c9f990 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:02.875766 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cb6c6-3eab-4721-839b-6f2c30c9f990 None admin] RBAC: Adding query filter params (interface=public, service_id=2e45ee64ae3740ab9fa81a32a0f8d01c, region_id=RegionOne) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:34:02.876084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cb6c6-3eab-4721-839b-6f2c30c9f990 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:02.877450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cb6c6-3eab-4721-839b-6f2c30c9f990 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:02.882478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 408/814] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Jul 25 09:34:02 2022] GET /identity/v3/endpoints?service_id=2e45ee64ae3740ab9fa81a32a0f8d01c&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:34:02.887919 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:02.987374 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355d37-bfc6-4dfc-91b4-1999f8a66cb4 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:03.020001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536665d-c093-432c-a7d1-6d5018fae15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:03.020652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536665d-c093-432c-a7d1-6d5018fae15d None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:03.020966 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536665d-c093-432c-a7d1-6d5018fae15d None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:03.021257 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536665d-c093-432c-a7d1-6d5018fae15d None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:03.021932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536665d-c093-432c-a7d1-6d5018fae15d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:03.023338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536665d-c093-432c-a7d1-6d5018fae15d None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:03.029365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 407/815] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Jul 25 09:34:02 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:34:05.254144 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86aa9-8b39-4e11-afcf-0df0bd428370 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:05.254793 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86aa9-8b39-4e11-afcf-0df0bd428370 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:05.254793 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86aa9-8b39-4e11-afcf-0df0bd428370 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:05.256137 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 409/816] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:34:05.261202 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1020-92e9-4dd8-8a03-5a673b9bc598 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:05.261661 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1020-92e9-4dd8-8a03-5a673b9bc598 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:05.261774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df1020-92e9-4dd8-8a03-5a673b9bc598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:05.281119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-28df1020-92e9-4dd8-8a03-5a673b9bc598 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:34:05.282275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-28df1020-92e9-4dd8-8a03-5a673b9bc598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:34:05.336242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:05.348908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 408/817] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:34:05 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 09:34:05.372608 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86aa9-8b39-4e11-afcf-0df0bd428370 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:05.472208 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86aa9-8b39-4e11-afcf-0df0bd428370 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:05.505240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:05.505959 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:05.506244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:05.506553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:05.507203 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:05.508571 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:05.511083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:34:05.521034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:34:05.523958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:34:05.524846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 410/818] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:34:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:34:05.528299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1020-92e9-4dd8-8a03-5a673b9bc598 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:05.627384 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df1020-92e9-4dd8-8a03-5a673b9bc598 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:05.661516 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:05.662181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:05.662495 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:05.662777 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:05.663478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] RBAC: Adding query filter params (name=compute) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:34:05.663788 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:05.665181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:05.669885 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 409/819] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:34:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:34:05.676082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:05.777781 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65bbb3-4c9f-4fb8-9b89-0bee4a0d5f68 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:05.810803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e9382-e004-4ebb-8d9a-5b69f4a121af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:05.812070 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9382-e004-4ebb-8d9a-5b69f4a121af None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:05.812488 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9382-e004-4ebb-8d9a-5b69f4a121af None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:05.812768 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9382-e004-4ebb-8d9a-5b69f4a121af None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:05.813467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e9382-e004-4ebb-8d9a-5b69f4a121af None admin] RBAC: Adding query filter params (type=compute) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:34:05.813775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e9382-e004-4ebb-8d9a-5b69f4a121af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:05.815171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e9382-e004-4ebb-8d9a-5b69f4a121af None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:05.819906 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 411/820] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Jul 25 09:34:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:34:05.825764 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:34:05.881879 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:05.925079 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422236f-3138-43be-b332-ebff9c680f2f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:34:05.959011 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868712d-b8b4-466d-bdf8-0d71207e1161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:34:05.959662 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868712d-b8b4-466d-bdf8-0d71207e1161 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:34:05.959952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868712d-b8b4-466d-bdf8-0d71207e1161 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:34:05.960230 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868712d-b8b4-466d-bdf8-0d71207e1161 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:34:05.960971 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868712d-b8b4-466d-bdf8-0d71207e1161 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:34:05.962334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868712d-b8b4-466d-bdf8-0d71207e1161 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:34:06.058142 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 410/821] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:34:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:34:15.817472 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=68 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:34:16.053564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=44,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:29.765280 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a25b-a657-4fca-96db-1502c26b09b7 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:29.765845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a25b-a657-4fca-96db-1502c26b09b7 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:29.765845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a25b-a657-4fca-96db-1502c26b09b7 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:29.767239 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 412/822] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:35:29.773363 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b860-5786-4a89-8797-c21229021399 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:29.775010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b860-5786-4a89-8797-c21229021399 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:29.775010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95b860-5786-4a89-8797-c21229021399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:29.792772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-5c95b860-5786-4a89-8797-c21229021399 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:35:29.797958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-5c95b860-5786-4a89-8797-c21229021399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:35:29.866132 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 411/823] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:35:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:35:29.890882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531a25b-a657-4fca-96db-1502c26b09b7 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:29.992862 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531a25b-a657-4fca-96db-1502c26b09b7 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:30.028171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:30.028874 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:30.029162 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:30.029441 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:30.039957 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:30.041459 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:30.058227 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:30.059220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:30.060272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:30.060272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:30.060272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:30.060272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:30.060272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 413/824] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:30.065626 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95b860-5786-4a89-8797-c21229021399 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:30.164274 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95b860-5786-4a89-8797-c21229021399 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:30.189478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:30.198394 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d72f5-6c22-4b1b-98f4-686ba69dd28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:30.199079 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d72f5-6c22-4b1b-98f4-686ba69dd28e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:30.199367 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d72f5-6c22-4b1b-98f4-686ba69dd28e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:30.199645 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d72f5-6c22-4b1b-98f4-686ba69dd28e None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:30.200362 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d72f5-6c22-4b1b-98f4-686ba69dd28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:30.200669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d72f5-6c22-4b1b-98f4-686ba69dd28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:30.202032 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d72f5-6c22-4b1b-98f4-686ba69dd28e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:30.213784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 412/825] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:30.219893 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:30.274224 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:30.319878 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a69a-d0fb-4b6c-a3b9-f8c18d68c410 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:30.353721 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36aeb1-d910-47f7-b55b-7350ada2bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:30.354390 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36aeb1-d910-47f7-b55b-7350ada2bf61 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:30.354731 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36aeb1-d910-47f7-b55b-7350ada2bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:30.354997 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36aeb1-d910-47f7-b55b-7350ada2bf61 None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:30.355713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36aeb1-d910-47f7-b55b-7350ada2bf61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:30.357140 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36aeb1-d910-47f7-b55b-7350ada2bf61 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:30.628986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 414/826] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Jul 25 09:35:30 2022] POST /identity/v3/users => generated 251 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:35:32.907715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d8b83-3eca-48a4-9d79-07cdb17aa7be None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:32.908252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d8b83-3eca-48a4-9d79-07cdb17aa7be None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:32.908252 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d8b83-3eca-48a4-9d79-07cdb17aa7be None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:32.909641 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 413/827] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:35:32.914903 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761907-ba23-4ad9-a3ad-9521a7bb7c24 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:32.915301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761907-ba23-4ad9-a3ad-9521a7bb7c24 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:32.915475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761907-ba23-4ad9-a3ad-9521a7bb7c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:32.934029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-74761907-ba23-4ad9-a3ad-9521a7bb7c24 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:35:32.935353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-74761907-ba23-4ad9-a3ad-9521a7bb7c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:35:33.002412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 415/828] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:35:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:35:33.027158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d8b83-3eca-48a4-9d79-07cdb17aa7be None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:33.128971 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d8b83-3eca-48a4-9d79-07cdb17aa7be None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:33.161128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d67da-0b7a-43cb-8501-63648bb36d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:33.161850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d67da-0b7a-43cb-8501-63648bb36d05 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:33.162133 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d67da-0b7a-43cb-8501-63648bb36d05 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:33.162408 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d67da-0b7a-43cb-8501-63648bb36d05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:33.172590 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d67da-0b7a-43cb-8501-63648bb36d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-350d67da-0b7a-43cb-8501-63648bb36d05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:35:33.180798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:33.182237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:33.183130 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 414/829] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:33.188046 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74761907-ba23-4ad9-a3ad-9521a7bb7c24 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:33.227989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:33.286830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74761907-ba23-4ad9-a3ad-9521a7bb7c24 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:33.323241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:33.323897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:33.324178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:33.324455 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:33.325280 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:33.325583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:33.327037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:33.336126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 416/830] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:33.341944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d67da-0b7a-43cb-8501-63648bb36d05 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:33.391569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:33.444019 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d67da-0b7a-43cb-8501-63648bb36d05 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:33.477484 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:33.478302 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:33.478614 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:33.478895 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:33.489479 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:33.490990 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:33.509128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:33.510166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:33.511336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:33.511336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:33.511336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:33.511336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:33.511336 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 415/831] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:33.518196 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:33.614259 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:33.617245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955482a-ab70-4745-a198-fb1ded7ae3a4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:33.651634 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:33.652295 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:33.652578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:33.652852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:33.653568 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:33.653872 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:33.655267 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:33.666947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 417/832] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:33.672636 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:33.768981 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:33.772799 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a381c-f4f0-4bbb-8571-b5991b239ec7 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:33.805558 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:33.806395 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:33.806705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:33.806980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:33.814195 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:33.815668 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:35:33.829814 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:33.830959 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:33.832519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 416/833] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:33.837030 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:33.940135 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cdb64-bd21-40bb-9770-73c56058c1a4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:33.973467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:33.974228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:33.974615 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:33.974905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:33.975832 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:33.976152 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:33.977596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:33.995902 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 418/834] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Jul 25 09:35:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:34.001787 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:34.103498 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cfc6e-a2d0-49c0-8145-513dff6e4b77 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:34.138014 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf782ed-46af-475c-8ba4-6acb2ca176ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:34.138696 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf782ed-46af-475c-8ba4-6acb2ca176ae None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:34.138984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf782ed-46af-475c-8ba4-6acb2ca176ae None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:34.139261 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf782ed-46af-475c-8ba4-6acb2ca176ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:34.168434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:34.210138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf782ed-46af-475c-8ba4-6acb2ca176ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:34.211711 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf782ed-46af-475c-8ba4-6acb2ca176ae None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:34.312255 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 417/835] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:35:34 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 09:35:34.318147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:34.338099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:34.416928 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f15f-cab8-4e7f-9770-41474bd5996d None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:34.449168 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:34.449969 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:34.450337 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:34.450659 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:34.462606 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:34.464058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:34.482671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:34.483578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:34.484539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:34.484539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:34.484539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:34.484539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:34.484539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 419/836] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:34.489734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf782ed-46af-475c-8ba4-6acb2ca176ae None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:34.547637 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:34.590360 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf782ed-46af-475c-8ba4-6acb2ca176ae None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:34.623148 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:34.623806 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:34.624095 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:34.624375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:34.625088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:34.625397 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:34.626803 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:34.638212 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 418/837] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:34.643994 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:34.715310 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:34.745402 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e53261-2568-469d-8525-b2b2e3e5f87f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:34.779177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:34.780000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:34.780291 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:34.780575 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:34.788812 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:34.790546 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:35:34.804790 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:34.805844 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:34.806897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 420/838] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:34.811807 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:34.910434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e6447-2e24-4449-980b-0b3f9ce6867a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:34.926935 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:34.943593 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857b785-666f-4e90-9550-34a665e4bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:34.944251 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b785-666f-4e90-9550-34a665e4bf0b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:34.944542 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b785-666f-4e90-9550-34a665e4bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:34.944826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b785-666f-4e90-9550-34a665e4bf0b None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:34.945611 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857b785-666f-4e90-9550-34a665e4bf0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:34.945969 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857b785-666f-4e90-9550-34a665e4bf0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:34.947436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857b785-666f-4e90-9550-34a665e4bf0b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:34.959849 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 419/839] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:35:34.966079 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:35.067228 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e968d-68cc-4e06-a60e-c3be5c75868f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:35.095380 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:35.101930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd583d7c-e0fb-4df7-bbc5-ddb6e85f4cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:35.102606 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583d7c-e0fb-4df7-bbc5-ddb6e85f4cb9 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:35.102893 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583d7c-e0fb-4df7-bbc5-ddb6e85f4cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:35.103173 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583d7c-e0fb-4df7-bbc5-ddb6e85f4cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:35.103998 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd583d7c-e0fb-4df7-bbc5-ddb6e85f4cb9 None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=87520f22c3e944b4912d94c52e6ce84e) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:35.104313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd583d7c-e0fb-4df7-bbc5-ddb6e85f4cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:35.105734 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd583d7c-e0fb-4df7-bbc5-ddb6e85f4cb9 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:35.111026 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 421/840] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:35:34 2022] GET /identity/v3/role_assignments?user.id=87520f22c3e944b4912d94c52e6ce84e&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:37.304123 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2160bd-e3e3-4061-ab71-cca8cc74ba92 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:37.304682 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2160bd-e3e3-4061-ab71-cca8cc74ba92 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:37.304778 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2160bd-e3e3-4061-ab71-cca8cc74ba92 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:37.306145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 420/841] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:35:37.311178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd3c1-13b8-47a2-a4f4-3a3f77a43991 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:37.311605 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd3c1-13b8-47a2-a4f4-3a3f77a43991 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:37.311747 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd3c1-13b8-47a2-a4f4-3a3f77a43991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:37.330239 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-64dcd3c1-13b8-47a2-a4f4-3a3f77a43991 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:35:37.331454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-64dcd3c1-13b8-47a2-a4f4-3a3f77a43991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:35:37.400010 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 422/842] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:35:37 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:35:37.424081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2160bd-e3e3-4061-ab71-cca8cc74ba92 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:37.525631 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2160bd-e3e3-4061-ab71-cca8cc74ba92 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:37.558384 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9d24-5077-4295-9690-fd7962ecb68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:37.559163 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9d24-5077-4295-9690-fd7962ecb68c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:37.559444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9d24-5077-4295-9690-fd7962ecb68c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:37.559723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9d24-5077-4295-9690-fd7962ecb68c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:37.574304 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9d24-5077-4295-9690-fd7962ecb68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-91fd9d24-5077-4295-9690-fd7962ecb68c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:35:37.583086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:37.584197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:37.585190 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 421/843] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:35:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:37.590293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd3c1-13b8-47a2-a4f4-3a3f77a43991 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:37.688918 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd3c1-13b8-47a2-a4f4-3a3f77a43991 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:37.713015 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:37.723272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:37.724007 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:37.724301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:37.724587 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:37.725339 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] RBAC: Adding query filter params (name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:37.725653 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:37.727060 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:37.734823 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 423/844] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:35:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:37.740603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9d24-5077-4295-9690-fd7962ecb68c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:37.783566 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:37.842045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9d24-5077-4295-9690-fd7962ecb68c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:37.874477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:37.875329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:37.875612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:37.875886 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:37.887596 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:37.889035 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:37.905970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:37.907070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:37.908329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:37.908329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:37.908329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:37.908329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:37.908329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 422/845] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:37.913043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:38.012233 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30108b8e-e014-4c74-96ef-afd4f3bb7321 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:38.044754 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:38.045414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:38.045700 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:38.045989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:38.046724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:38.047033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:38.048405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:38.060470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 424/846] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:38.066937 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:38.158869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:38.168356 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaed5a-f69f-4879-87cd-c042f262fa8a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:38.202279 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:38.207086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:38.207086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:38.207086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:38.211433 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:38.212908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:35:38.227341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:38.228497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:38.229573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 423/847] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:38.234534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:38.282392 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:38.334101 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bfcb2-6fe0-4381-897f-7918f2ec17e0 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:38.372397 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:38.373081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:38.373375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:38.373657 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:38.374523 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:38.378264 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:38.378264 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:38.393201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 425/848] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Jul 25 09:35:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:38.399216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:38.499733 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6f9cb-eecd-46d3-9be6-dcbb11c4a939 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:38.531949 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:38.532713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:38.533000 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:38.533280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:38.544135 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:38.545582 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:38.562812 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:38.563924 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:38.565073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:38.565073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:38.565073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:38.565073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:38.565073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 424/849] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:38.570050 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:38.670103 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b78df-7cb4-441c-8f4c-5120d38db1ee None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:38.672528 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:38.703871 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:38.704796 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:38.705086 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:38.705367 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:38.706089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:38.706403 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:38.708412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:38.719930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 426/850] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:38.726554 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:38.729467 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:38.824754 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639ac6-b10e-48d3-8b6d-6cab100b52ad None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:38.859233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:38.860071 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:38.860363 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:38.860645 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:38.867518 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:38.868966 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:35:38.883181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:38.884196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:38.885353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 425/851] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:38.890358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:38.990647 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118399b-9fcd-4218-8d12-bb7a0db7bc82 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:39.026352 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cec9b6-5bce-49da-a31b-5277dde85813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:39.027038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cec9b6-5bce-49da-a31b-5277dde85813 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:39.027324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cec9b6-5bce-49da-a31b-5277dde85813 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:39.027602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cec9b6-5bce-49da-a31b-5277dde85813 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:39.028386 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cec9b6-5bce-49da-a31b-5277dde85813 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:39.028695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cec9b6-5bce-49da-a31b-5277dde85813 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:39.030187 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cec9b6-5bce-49da-a31b-5277dde85813 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:39.042218 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 427/852] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:39.048487 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:39.112431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:39.151510 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56105c-c753-4434-a4a6-875df4d7c6f4 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:39.184720 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86460d-619a-4870-9eca-d1a36ede1500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:39.185605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86460d-619a-4870-9eca-d1a36ede1500 None admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:39.185895 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86460d-619a-4870-9eca-d1a36ede1500 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:39.186173 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86460d-619a-4870-9eca-d1a36ede1500 None admin] PATH_INFO: `/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/87520f22c3e944b4912d94c52e6ce84e/roles/70814e05a0934c5293dcd15c2ce9b60e` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:39.201833 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86460d-619a-4870-9eca-d1a36ede1500 None admin] RBAC: Authorizing `identity:create_grant(project_id=cba6578d329149e1b0d2b8c7714d275b, user_id=87520f22c3e944b4912d94c52e6ce84e, role_id=70814e05a0934c5293dcd15c2ce9b60e)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:39.203345 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86460d-619a-4870-9eca-d1a36ede1500 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:39.299559 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 426/853] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:35:39 2022] PUT /identity/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/87520f22c3e944b4912d94c52e6ce84e/roles/70814e05a0934c5293dcd15c2ce9b60e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:35:41.505170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8c10-d80d-4462-931b-641dc4db2694 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:41.505693 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8c10-d80d-4462-931b-641dc4db2694 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:41.505779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8c10-d80d-4462-931b-641dc4db2694 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:41.507131 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 428/854] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:35:41.512375 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c5da9-17c8-4241-9f40-ac1190acbfc5 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:41.512806 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c5da9-17c8-4241-9f40-ac1190acbfc5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:41.512934 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c5da9-17c8-4241-9f40-ac1190acbfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:41.531120 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-0c3c5da9-17c8-4241-9f40-ac1190acbfc5 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:35:41.532329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-0c3c5da9-17c8-4241-9f40-ac1190acbfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:35:41.600161 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 427/855] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:35:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:35:41.625361 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8c10-d80d-4462-931b-641dc4db2694 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:41.650541 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:41.727548 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8c10-d80d-4462-931b-641dc4db2694 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:41.759603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c054-4efb-4198-9483-91ec91f08d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:41.760380 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c054-4efb-4198-9483-91ec91f08d03 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:41.760662 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c054-4efb-4198-9483-91ec91f08d03 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:41.760934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1c054-4efb-4198-9483-91ec91f08d03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:41.771581 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1c054-4efb-4198-9483-91ec91f08d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-6dd1c054-4efb-4198-9483-91ec91f08d03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:35:41.780136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:41.781245 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:41.782282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 429/856] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Jul 25 09:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:41.788395 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c5da9-17c8-4241-9f40-ac1190acbfc5 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:41.830175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:41.885488 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c5da9-17c8-4241-9f40-ac1190acbfc5 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:41.919310 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:41.919971 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:41.920253 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:41.920534 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:41.921267 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] RBAC: Adding query filter params (name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:41.921574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:41.922998 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:41.930801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 428/857] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Jul 25 09:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:41.936533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c054-4efb-4198-9483-91ec91f08d03 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:42.023347 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:42.039186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1c054-4efb-4198-9483-91ec91f08d03 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:42.073170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:42.074225 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:42.074542 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:42.074828 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:42.086075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:42.087583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:42.104848 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:42.105883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:42.106936 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:42.106936 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:42.106936 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:42.106936 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:42.110835 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 430/858] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:42.111825 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:42.213858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376fb91-9379-4880-ae36-3fc45aacce4f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:42.216144 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:42.246547 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:42.247210 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:42.247597 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:42.247888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:42.248597 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:42.248905 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:42.250258 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:42.262020 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 429/859] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:35:42.267827 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:42.368098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c630e17-39ea-4455-acb3-eba34d9fa0c4 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:42.402487 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:42.403350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:42.403636 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:42.403937 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] PATH_INFO: `/v3/users/placement` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:42.406806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:42.411540 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:42.412975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:35:42.428118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:42.429411 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:42.430404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 431/860] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:42.435534 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:42.534432 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce1555-67aa-466c-88e0-613a701e122b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:42.568434 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:42.569091 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:42.569372 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:42.569646 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:42.570479 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:42.570803 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:42.572220 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:42.589723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 430/861] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Jul 25 09:35:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:42.595649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:42.694340 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c986f1-c0f7-46d4-bd9c-5cfcfa35d97f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:42.729609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353fb2a-fb8f-46a9-9b70-8f09a55e1f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:42.730262 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fb2a-fb8f-46a9-9b70-8f09a55e1f28 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:42.730602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fb2a-fb8f-46a9-9b70-8f09a55e1f28 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:42.730887 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fb2a-fb8f-46a9-9b70-8f09a55e1f28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:42.795863 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:42.802815 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353fb2a-fb8f-46a9-9b70-8f09a55e1f28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:42.805296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353fb2a-fb8f-46a9-9b70-8f09a55e1f28 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:42.899042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 432/862] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:35:42 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 09:35:42.904943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:42.930515 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:43.004378 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f185a5-8ca6-4b94-a3f2-5f545428647a None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:43.039378 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:43.040164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:43.040441 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:43.040758 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:43.050717 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:43.052907 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:43.070001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:43.071076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:43.071983 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:43.071983 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:43.071983 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:43.071983 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:43.071983 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 431/863] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:43.077076 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353fb2a-fb8f-46a9-9b70-8f09a55e1f28 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:43.172520 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:43.178438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353fb2a-fb8f-46a9-9b70-8f09a55e1f28 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:43.212035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:43.212694 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:43.212981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:43.213260 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:43.213979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:43.214288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:43.215737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:43.227220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 433/864] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:43.232901 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:43.307873 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:43.332382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d39d-ccab-4e35-bada-762748e4f9eb None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:43.367193 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:43.367984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:43.368265 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:43.368539 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:43.374953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:43.376461 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:35:43.390693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:43.391718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:43.392793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 432/865] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:43.398360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:43.498163 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d13c9-fdb3-49c8-bd57-d2ee3fc7812a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:43.531804 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd450c1-8194-4945-8bf8-6a145c7dca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:43.532465 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd450c1-8194-4945-8bf8-6a145c7dca79 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:43.532755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd450c1-8194-4945-8bf8-6a145c7dca79 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:43.533042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd450c1-8194-4945-8bf8-6a145c7dca79 None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:43.533860 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd450c1-8194-4945-8bf8-6a145c7dca79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:43.534172 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd450c1-8194-4945-8bf8-6a145c7dca79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:43.535693 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd450c1-8194-4945-8bf8-6a145c7dca79 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:43.547629 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 434/866] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:43.553882 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:43.654771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ad172-388e-4853-836d-a16d36e11ad2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:43.687356 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cca3c-8fd5-47c9-8ca1-308d3940add8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:43.688215 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cca3c-8fd5-47c9-8ca1-308d3940add8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:43.688510 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cca3c-8fd5-47c9-8ca1-308d3940add8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:43.688792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cca3c-8fd5-47c9-8ca1-308d3940add8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:43.689652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cca3c-8fd5-47c9-8ca1-308d3940add8 None admin] RBAC: Adding query filter params (role.id=70814e05a0934c5293dcd15c2ce9b60e, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=87520f22c3e944b4912d94c52e6ce84e) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:43.689968 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cca3c-8fd5-47c9-8ca1-308d3940add8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:43.691437 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cca3c-8fd5-47c9-8ca1-308d3940add8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:43.693931 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:43.698370 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 433/867] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:35:43 2022] GET /identity/v3/role_assignments?user.id=87520f22c3e944b4912d94c52e6ce84e&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=70814e05a0934c5293dcd15c2ce9b60e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:45.975605 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4253e-7fb7-49a1-8741-9c891fb60dd5 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:45.976191 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4253e-7fb7-49a1-8741-9c891fb60dd5 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:45.976191 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4253e-7fb7-49a1-8741-9c891fb60dd5 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:45.977543 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 435/868] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:35:45.982660 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5413a1-bf6b-4a09-9d49-e8dd06911f25 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:45.983061 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5413a1-bf6b-4a09-9d49-e8dd06911f25 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:45.983220 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5413a1-bf6b-4a09-9d49-e8dd06911f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:46.001798 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-ea5413a1-bf6b-4a09-9d49-e8dd06911f25 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:35:46.003023 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-ea5413a1-bf6b-4a09-9d49-e8dd06911f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:35:46.068823 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 434/869] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:35:45 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:35:46.094114 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4253e-7fb7-49a1-8741-9c891fb60dd5 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:46.112783 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:46.194145 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4253e-7fb7-49a1-8741-9c891fb60dd5 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:46.228309 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f8794-1449-4cc4-b4bb-71e62dd20de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:46.229042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8794-1449-4cc4-b4bb-71e62dd20de3 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:46.229333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8794-1449-4cc4-b4bb-71e62dd20de3 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:46.229615 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8794-1449-4cc4-b4bb-71e62dd20de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:46.240700 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f8794-1449-4cc4-b4bb-71e62dd20de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-cc9f8794-1449-4cc4-b4bb-71e62dd20de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:35:46.248300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:46.249427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:46.250327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 436/870] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:46.255744 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5413a1-bf6b-4a09-9d49-e8dd06911f25 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:46.354691 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5413a1-bf6b-4a09-9d49-e8dd06911f25 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:46.380855 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:46.388715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:46.389381 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:46.389669 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:46.389948 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:46.390905 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:46.391256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:46.392759 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:46.401394 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 435/871] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:46.407153 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f8794-1449-4cc4-b4bb-71e62dd20de3 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:46.486755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:46.509511 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f8794-1449-4cc4-b4bb-71e62dd20de3 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:46.542379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:46.543186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:46.543468 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:46.543743 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:46.554062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:46.555564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:46.572510 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:46.577064 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:46.578177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:46.578177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:46.578177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:46.578177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:46.578177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 437/872] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:46.579788 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:46.681701 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac02931-229b-4e97-a2b2-3e2e563ab26c None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:46.716197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:46.716859 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:46.717150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:46.717433 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:46.718147 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:46.718461 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:46.719857 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:46.732187 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 436/873] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:46.743543 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:46.851386 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22ac6b-f615-48c5-8ebf-3da20bcc2447 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:46.876986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:46.885344 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:46.886138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:46.886427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:46.886738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:46.894787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:46.896242 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:35:46.910439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:46.911613 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:46.917788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 438/874] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:46.918569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:46.968297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:47.016193 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211a72c-8944-4be9-a76d-21663dbbce94 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:47.048392 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:47.049055 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:47.049365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:47.049643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:47.050514 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:47.050822 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:47.052760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:47.070191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 437/875] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Jul 25 09:35:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:35:47.076182 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:47.175987 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e774c-c4ff-4564-a256-dc4b1f9aa134 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:47.209337 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1f58-8238-442d-9c37-8412c360ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:47.210023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1f58-8238-442d-9c37-8412c360ce23 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:47.210300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1f58-8238-442d-9c37-8412c360ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:47.210606 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1f58-8238-442d-9c37-8412c360ce23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:47.264860 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:47.277515 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade1f58-8238-442d-9c37-8412c360ce23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:47.279048 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade1f58-8238-442d-9c37-8412c360ce23 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:47.378572 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 439/876] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:35:47 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 09:35:47.384435 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:47.483622 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e5a02-440a-4759-ac48-721cbb3ea789 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:47.493502 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:47.517967 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:47.518790 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:47.519086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:47.519363 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:47.532285 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:47.532285 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:47.549008 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:47.555036 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:47.556167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:47.556167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:47.556167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:47.556167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:47.556167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 438/877] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:47.556869 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1f58-8238-442d-9c37-8412c360ce23 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:47.645374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:47.657439 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1f58-8238-442d-9c37-8412c360ce23 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:47.691642 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:47.692381 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:47.692679 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:47.692963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:47.693727 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:47.694042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:47.695460 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:47.708076 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 440/878] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:47.713930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:47.812697 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e43c-886e-4c6a-9c22-43b2435b2b57 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:47.846531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:47.847326 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:47.847612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:47.847888 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] PATH_INFO: `/v3/projects/service` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:47.855116 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:47.856559 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:35:47.870165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:47.871388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:47.872737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 439/879] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:47.877201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:47.978827 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74124e56-0cdc-417d-960b-61477e08b4ba None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:48.012144 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd737eb-252f-4989-99e6-7a2f249215cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:48.012783 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd737eb-252f-4989-99e6-7a2f249215cf None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:48.013090 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd737eb-252f-4989-99e6-7a2f249215cf None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:48.013394 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd737eb-252f-4989-99e6-7a2f249215cf None admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:48.014167 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd737eb-252f-4989-99e6-7a2f249215cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:48.014490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd737eb-252f-4989-99e6-7a2f249215cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:48.015943 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd737eb-252f-4989-99e6-7a2f249215cf None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:48.028413 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 441/880] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:48.034789 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:48.058256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:48.135856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e82b2-cc5c-47b4-b7b8-d905b98dbcda None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:48.170278 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636e51-e89e-432c-a422-34dee2630fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:48.170967 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636e51-e89e-432c-a422-34dee2630fbd None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:48.171259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636e51-e89e-432c-a422-34dee2630fbd None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:48.171543 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636e51-e89e-432c-a422-34dee2630fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:48.172410 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42636e51-e89e-432c-a422-34dee2630fbd None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=87520f22c3e944b4912d94c52e6ce84e) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:48.172715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42636e51-e89e-432c-a422-34dee2630fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:48.174153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42636e51-e89e-432c-a422-34dee2630fbd None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:48.180001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 440/881] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:35:48 2022] GET /identity/v3/role_assignments?user.id=87520f22c3e944b4912d94c52e6ce84e&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=bd8b88fae376413398183761500b2e1d => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:35:50.366124 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94da24-1ac8-4f41-a36c-083b1830e028 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:50.366610 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94da24-1ac8-4f41-a36c-083b1830e028 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:50.366710 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94da24-1ac8-4f41-a36c-083b1830e028 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:50.368087 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 442/882] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:35:50.373928 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e669ad-cd22-43c2-bcfb-9b6752023c66 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:50.373928 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e669ad-cd22-43c2-bcfb-9b6752023c66 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:50.373928 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e669ad-cd22-43c2-bcfb-9b6752023c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:50.392373 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-52e669ad-cd22-43c2-bcfb-9b6752023c66 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:35:50.396371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-52e669ad-cd22-43c2-bcfb-9b6752023c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:35:50.462799 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 441/883] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:35:50 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:35:50.486746 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94da24-1ac8-4f41-a36c-083b1830e028 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:50.498317 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:50.589700 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94da24-1ac8-4f41-a36c-083b1830e028 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:50.624002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e4344-e294-4293-8e2c-b7b2f8e2a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:50.624794 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e4344-e294-4293-8e2c-b7b2f8e2a845 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:50.625082 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e4344-e294-4293-8e2c-b7b2f8e2a845 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:50.625382 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e4344-e294-4293-8e2c-b7b2f8e2a845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:50.636360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e4344-e294-4293-8e2c-b7b2f8e2a845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-871e4344-e294-4293-8e2c-b7b2f8e2a845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:35:50.644078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:50.645216 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:50.646498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 443/884] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:50.651594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e669ad-cd22-43c2-bcfb-9b6752023c66 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:50.666977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:50.750792 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e669ad-cd22-43c2-bcfb-9b6752023c66 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:50.784115 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:50.784782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:50.785075 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:50.785353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:50.786242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:50.786582 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:50.787995 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:50.796243 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 442/885] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:50.802507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e4344-e294-4293-8e2c-b7b2f8e2a845 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:50.870081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:50.903135 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e4344-e294-4293-8e2c-b7b2f8e2a845 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:50.936674 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:50.940852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:50.940852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:50.940852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:50.949578 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:50.951067 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:50.968118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:50.969118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:50.970353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:50.970353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:50.970353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:50.970353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:50.970353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 444/886] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:50.975767 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:51.054216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:51.077301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545da91e-d5db-4df3-b430-5a4ce1503774 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:51.110395 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:51.111123 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:51.111412 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:51.111693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:51.112410 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:51.112722 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:51.114240 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:51.126455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 443/887] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:51.132755 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:51.231069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b387999-63ea-4a15-ac9c-467fd9a6d84f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:51.249705 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:51.263431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:51.264223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:51.264506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:51.264779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:51.272759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:51.274203 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:35:51.288654 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:51.289876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:51.293240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 445/888] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:51.295717 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:51.398356 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce7185-d678-4401-a515-ca34f86f17a9 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:51.431782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:51.435033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:51.435033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:51.435033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:51.435033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:51.435033 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:51.435562 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:51.438038 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:51.452932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 444/889] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Jul 25 09:35:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:51.459037 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:51.558608 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aab966-59e5-4500-9755-5e7f8dc98f20 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:51.591436 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:51.592239 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:51.592506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:51.592782 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:51.603083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:51.604542 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:51.621650 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:51.627579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:51.628559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:51.628559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:51.628559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:51.628559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:51.628559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 446/890] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 09:35:51.628841 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:51.728308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141302d-f4fb-47fc-8243-7c8a9ab08367 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:51.761683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:51.762365 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:51.764681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:51.764681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:51.764681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:51.764681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:51.765418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:51.776811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 445/891] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:51.782490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:51.817116 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:51.883891 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49478e76-282f-4892-9579-3ff3d8d32435 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:51.917668 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:51.918515 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:51.918806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:51.923599 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:51.925626 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:51.927853 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:35:51.941232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:51.942638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:51.943591 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 447/892] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:51.948362 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:52.005860 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:52.050403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218feaf7-5e3b-4096-adaf-ab2ad76ebb2f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:52.084660 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae16189-98dc-4fcb-a49b-3f27bf94ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:52.085322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae16189-98dc-4fcb-a49b-3f27bf94ccf0 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:52.085612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae16189-98dc-4fcb-a49b-3f27bf94ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:52.085894 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae16189-98dc-4fcb-a49b-3f27bf94ccf0 None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:52.086754 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae16189-98dc-4fcb-a49b-3f27bf94ccf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:52.087283 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae16189-98dc-4fcb-a49b-3f27bf94ccf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:52.088880 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae16189-98dc-4fcb-a49b-3f27bf94ccf0 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:52.102711 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 446/893] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:52.108743 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:52.199867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:52.208986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b989e-dd2e-4202-b772-4903db76a920 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:52.241975 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904fff6-9ccf-464a-bd68-04d02713d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:52.242883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904fff6-9ccf-464a-bd68-04d02713d94d None admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:52.243168 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904fff6-9ccf-464a-bd68-04d02713d94d None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:52.243443 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904fff6-9ccf-464a-bd68-04d02713d94d None admin] PATH_INFO: `/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/87520f22c3e944b4912d94c52e6ce84e/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:52.245398 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904fff6-9ccf-464a-bd68-04d02713d94d None admin] RBAC: Authorizing `identity:create_grant(project_id=cba6578d329149e1b0d2b8c7714d275b, user_id=87520f22c3e944b4912d94c52e6ce84e, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:52.246862 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904fff6-9ccf-464a-bd68-04d02713d94d None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:52.412035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 448/894] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Jul 25 09:35:52 2022] PUT /identity/v3/projects/cba6578d329149e1b0d2b8c7714d275b/users/87520f22c3e944b4912d94c52e6ce84e/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:35:54.614874 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3468e06-f574-4350-af45-44f5590df4ce None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:54.615382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3468e06-f574-4350-af45-44f5590df4ce None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:54.615382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3468e06-f574-4350-af45-44f5590df4ce None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:54.616709 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 447/895] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:35:54.622028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963051-5d4e-4726-92dc-f422426f4f64 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:54.622432 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963051-5d4e-4726-92dc-f422426f4f64 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:54.622671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963051-5d4e-4726-92dc-f422426f4f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:54.641263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-b8963051-5d4e-4726-92dc-f422426f4f64 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:35:54.642455 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-b8963051-5d4e-4726-92dc-f422426f4f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:35:54.709358 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 449/896] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:35:54 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:35:54.734689 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3468e06-f574-4350-af45-44f5590df4ce None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:54.836509 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3468e06-f574-4350-af45-44f5590df4ce None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:54.850946 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:54.871165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba718c-b258-4976-aa80-83601abc729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:54.871941 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba718c-b258-4976-aa80-83601abc729b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:54.872239 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba718c-b258-4976-aa80-83601abc729b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:54.872528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba718c-b258-4976-aa80-83601abc729b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:54.882578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba718c-b258-4976-aa80-83601abc729b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-90ba718c-b258-4976-aa80-83601abc729b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 09:35:54.890272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:54.891344 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:54.892572 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 448/897] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Jul 25 09:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:54.897576 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8963051-5d4e-4726-92dc-f422426f4f64 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:54.978906 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:54.997167 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8963051-5d4e-4726-92dc-f422426f4f64 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:55.029973 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:55.030671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:55.030964 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:55.031238 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:55.031995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:55.032307 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:55.033682 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:55.042180 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 450/898] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Jul 25 09:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:55.048002 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba718c-b258-4976-aa80-83601abc729b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:55.149576 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba718c-b258-4976-aa80-83601abc729b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:55.182850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:55.183677 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:55.183960 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:55.184234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:55.194475 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:55.195936 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:55.213490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:55.214630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:55.215760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:55.215760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:55.215760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:55.215760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:55.215760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 449/899] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:55.220646 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:55.321049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2f1f-6e14-4879-ac78-5173c91dac73 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:55.356436 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:55.357092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:55.357376 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:55.357652 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:55.358364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:55.358704 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:55.360076 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:55.371865 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 451/900] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:55.377667 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:55.405777 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:55.476418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116dcdf-27ab-41ff-8bf2-8a31681b2de8 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:55.510201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:55.511043 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:55.511338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:55.511620 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:55.519159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:55.521338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 09:35:55.535734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:55.536978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:55.538505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 450/901] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:55.543002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:55.546918 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:55.642553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1448-ee6d-480f-9b68-19579c7fa99b None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:55.675564 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:55.676164 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:55.676448 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:55.676722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:55.677811 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:55.678118 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:55.679584 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:55.698752 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 452/902] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Jul 25 09:35:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:55.705081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:55.794391 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:55.809455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa9945-6a5f-4541-a771-0e2b2d77ea7e None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:55.845912 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfe505-2008-4b43-829c-a95608734500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:55.846585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe505-2008-4b43-829c-a95608734500 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:55.846877 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe505-2008-4b43-829c-a95608734500 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:55.847158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe505-2008-4b43-829c-a95608734500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:55.919806 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfe505-2008-4b43-829c-a95608734500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:55.921641 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfe505-2008-4b43-829c-a95608734500 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:56.016452 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:56.033175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 451/903] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Jul 25 09:35:55 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 09:35:56.041475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:56.110589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:56.153751 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ac899-c364-44f6-b422-58058e839c1a None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:56.192207 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:56.193652 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:56.193931 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:56.194205 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:56.204725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:56.206304 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 09:35:56.229506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:56.230759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:56.231832 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 09:35:56.231832 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 09:35:56.231832 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 09:35:56.231832 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:56.231832 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 453/904] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:56.237609 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfe505-2008-4b43-829c-a95608734500 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:56.350090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfe505-2008-4b43-829c-a95608734500 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:56.391408 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:56.392125 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:56.392414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:56.392693 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:56.393409 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:56.393717 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:56.395131 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:56.408597 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 452/905] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Jul 25 09:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:56.415918 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:56.522933 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55cc3-f743-4c6d-9400-e26cedb14738 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:56.539986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:56.560779 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:56.561590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:56.561879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:56.562160 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:56.570030 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:56.571652 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 09:35:56.586807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:56.587703 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: ERROR keystone.server.flask.application Jul 25 09:35:56.588787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 454/906] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Jul 25 09:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:56.594100 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:56.641733 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:56.695801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341323f-1f83-4fe8-87a7-4b5b3d55c53f None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:56.729199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ac0cc-c8f8-4cad-b6a7-da5bf8d028bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:56.729882 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac0cc-c8f8-4cad-b6a7-da5bf8d028bf None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:56.730128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac0cc-c8f8-4cad-b6a7-da5bf8d028bf None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:56.730402 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac0cc-c8f8-4cad-b6a7-da5bf8d028bf None admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:56.731213 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ac0cc-c8f8-4cad-b6a7-da5bf8d028bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:56.731522 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ac0cc-c8f8-4cad-b6a7-da5bf8d028bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:56.733010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ac0cc-c8f8-4cad-b6a7-da5bf8d028bf None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:56.746961 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 453/907] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Jul 25 09:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:56.752532 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:56.855115 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018c4b-e771-4e91-8ffa-7fbbeac07c05 None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:56.890280 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254b848-b572-4632-b40e-b0e9d1851872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:56.890958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b848-b572-4632-b40e-b0e9d1851872 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:56.891299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b848-b572-4632-b40e-b0e9d1851872 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:56.891585 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254b848-b572-4632-b40e-b0e9d1851872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:56.892477 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b848-b572-4632-b40e-b0e9d1851872 None admin] RBAC: Adding query filter params (role.id=bd8b88fae376413398183761500b2e1d, scope.project.id=cba6578d329149e1b0d2b8c7714d275b, user.id=87520f22c3e944b4912d94c52e6ce84e) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:56.892793 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b848-b572-4632-b40e-b0e9d1851872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:56.894278 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254b848-b572-4632-b40e-b0e9d1851872 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:56.900350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 455/908] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Jul 25 09:35:56 2022] GET /identity/v3/role_assignments?user.id=87520f22c3e944b4912d94c52e6ce84e&scope.project.id=cba6578d329149e1b0d2b8c7714d275b&role.id=bd8b88fae376413398183761500b2e1d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:59.157923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76d91-8250-4c0f-9895-96bfa37fdbb3 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:59.158460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76d91-8250-4c0f-9895-96bfa37fdbb3 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:59.158460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76d91-8250-4c0f-9895-96bfa37fdbb3 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:59.159826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 454/909] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:35:59.165914 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeffed8-aeb2-4410-a599-9379fb28df0f None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:59.166340 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeffed8-aeb2-4410-a599-9379fb28df0f None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:59.166493 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeffed8-aeb2-4410-a599-9379fb28df0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:59.184586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-cbeffed8-aeb2-4410-a599-9379fb28df0f None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:35:59.185815 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-cbeffed8-aeb2-4410-a599-9379fb28df0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:35:59.216610 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:59.252693 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 456/910] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:35:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:35:59.276849 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76d91-8250-4c0f-9895-96bfa37fdbb3 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:59.378806 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76d91-8250-4c0f-9895-96bfa37fdbb3 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:59.386674 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:35:59.412955 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:59.413683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:59.413974 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:59.414256 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] PATH_INFO: `/v3/services/placement` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:59.414933 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:59.416330 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:35:59.429233 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:35:59.430535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:35:59.431770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 455/911] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Jul 25 09:35:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:35:59.436523 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeffed8-aeb2-4410-a599-9379fb28df0f None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:59.538079 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeffed8-aeb2-4410-a599-9379fb28df0f None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:59.572113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd0084-7002-45f4-9496-800b85bc6b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:59.572775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd0084-7002-45f4-9496-800b85bc6b39 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:59.573068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd0084-7002-45f4-9496-800b85bc6b39 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:59.573350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd0084-7002-45f4-9496-800b85bc6b39 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:59.574055 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd0084-7002-45f4-9496-800b85bc6b39 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:59.574366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd0084-7002-45f4-9496-800b85bc6b39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:59.575771 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd0084-7002-45f4-9496-800b85bc6b39 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:59.580839 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 457/912] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Jul 25 09:35:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:35:59.586740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:35:59.687099 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ab3a9-61c5-4489-99c0-4e1a89d4ddca None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:35:59.721097 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35081b17-b782-4a4a-852b-c574300c3691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:35:59.721760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081b17-b782-4a4a-852b-c574300c3691 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:35:59.722050 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081b17-b782-4a4a-852b-c574300c3691 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:35:59.722332 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081b17-b782-4a4a-852b-c574300c3691 None admin] PATH_INFO: `/v3/services` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:35:59.723069 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35081b17-b782-4a4a-852b-c574300c3691 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:35:59.723382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35081b17-b782-4a4a-852b-c574300c3691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:35:59.724785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35081b17-b782-4a4a-852b-c574300c3691 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:35:59.729277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 456/913] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Jul 25 09:35:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:36:01.919922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2969-8c1d-4142-9256-5121d1d75d6c None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:01.920487 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2969-8c1d-4142-9256-5121d1d75d6c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:01.920487 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2969-8c1d-4142-9256-5121d1d75d6c None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:01.921829 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 458/914] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:36:01.927207 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac977450-d8a6-4352-b5fe-458a64f2adb5 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:01.927663 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac977450-d8a6-4352-b5fe-458a64f2adb5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:01.927809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac977450-d8a6-4352-b5fe-458a64f2adb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:01.946881 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-ac977450-d8a6-4352-b5fe-458a64f2adb5 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:36:01.948067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-ac977450-d8a6-4352-b5fe-458a64f2adb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:36:01.975769 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:36:02.014715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 457/915] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:36:01 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:36:02.039368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db2969-8c1d-4142-9256-5121d1d75d6c None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:36:02.069821 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:36:02.140604 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db2969-8c1d-4142-9256-5121d1d75d6c None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:36:02.176006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b062ee0-16df-4521-99c2-25c2d2b968a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:36:02.176603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062ee0-16df-4521-99c2-25c2d2b968a4 None admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:02.176891 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062ee0-16df-4521-99c2-25c2d2b968a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:02.177168 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062ee0-16df-4521-99c2-25c2d2b968a4 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:02.178103 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b062ee0-16df-4521-99c2-25c2d2b968a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:36:02.179635 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b062ee0-16df-4521-99c2-25c2d2b968a4 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:36:02.278722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 459/916] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Jul 25 09:36:02 2022] POST /identity/v3/services => generated 246 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:36:04.534634 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70f62-d169-4b61-9d6a-f686a87e3210 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:04.535157 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70f62-d169-4b61-9d6a-f686a87e3210 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:04.535247 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb70f62-d169-4b61-9d6a-f686a87e3210 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:04.536599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 458/917] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:36:04.541817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1b0dd-5fe5-40e5-a3d2-f92215c11fe6 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:04.542241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1b0dd-5fe5-40e5-a3d2-f92215c11fe6 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:04.542385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1b0dd-5fe5-40e5-a3d2-f92215c11fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:04.560533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-b5a1b0dd-5fe5-40e5-a3d2-f92215c11fe6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:36:04.561722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-b5a1b0dd-5fe5-40e5-a3d2-f92215c11fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:36:04.635967 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 460/918] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:36:04 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:36:04.659737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb70f62-d169-4b61-9d6a-f686a87e3210 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:36:04.760397 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb70f62-d169-4b61-9d6a-f686a87e3210 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:36:04.793240 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:36:04.794028 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:04.794308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:04.794623 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] PATH_INFO: `/v3/services/placement` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:04.795275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:36:04.796629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:36:04.808848 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:36:04.810040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:36:04.810980 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 459/919] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Jul 25 09:36:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:36:04.816083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1b0dd-5fe5-40e5-a3d2-f92215c11fe6 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:36:04.835018 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:36:04.912294 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1b0dd-5fe5-40e5-a3d2-f92215c11fe6 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:36:04.946042 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:36:04.946734 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:04.947026 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:04.947311 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:04.948020 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:36:04.948333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:36:04.949708 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:36:04.954942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 461/920] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Jul 25 09:36:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:36:04.961010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:36:04.989459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:36:05.059303 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705e4e1-4c3e-4222-b486-556f22b5737b None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:36:05.092616 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d9f87-be49-49e8-80e9-162418bcea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:36:05.093265 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9f87-be49-49e8-80e9-162418bcea48 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:05.093551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9f87-be49-49e8-80e9-162418bcea48 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:05.093826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d9f87-be49-49e8-80e9-162418bcea48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:05.094631 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d9f87-be49-49e8-80e9-162418bcea48 None admin] RBAC: Adding query filter params (interface=public, service_id=16f6bfa31ce44e51a6424e4b43f4c52a, region_id=RegionOne) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:36:05.094939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d9f87-be49-49e8-80e9-162418bcea48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:36:05.096294 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d9f87-be49-49e8-80e9-162418bcea48 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:36:05.101166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 460/921] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Jul 25 09:36:04 2022] GET /identity/v3/endpoints?service_id=16f6bfa31ce44e51a6424e4b43f4c52a&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:36:05.106959 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:36:05.190043 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:36:05.207551 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d202ff1-e612-46c4-b2bc-e07f0691cd5f None admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:36:05.241590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b6f44-3a82-49bd-9655-0582fae53e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:36:05.242247 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6f44-3a82-49bd-9655-0582fae53e91 None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:05.242559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6f44-3a82-49bd-9655-0582fae53e91 None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:05.242838 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6f44-3a82-49bd-9655-0582fae53e91 None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:05.243516 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b6f44-3a82-49bd-9655-0582fae53e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:36:05.244877 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b6f44-3a82-49bd-9655-0582fae53e91 None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:36:05.251186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 462/922] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Jul 25 09:36:05 2022] GET /identity/v3/services => generated 1962 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:36:07.537882 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6c89-ef11-4101-8928-8d4b0cbf1cd4 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:07.538405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6c89-ef11-4101-8928-8d4b0cbf1cd4 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:07.538580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c6c89-ef11-4101-8928-8d4b0cbf1cd4 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:07.539842 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 461/923] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:36:07.545146 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0613b-69fa-4c81-bf04-6ea1ebfaf529 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:07.545558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0613b-69fa-4c81-bf04-6ea1ebfaf529 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:07.545701 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0613b-69fa-4c81-bf04-6ea1ebfaf529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:07.564296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-d3b0613b-69fa-4c81-bf04-6ea1ebfaf529 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:36:07.565475 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-d3b0613b-69fa-4c81-bf04-6ea1ebfaf529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:36:07.633781 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 463/924] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:36:07 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 09:36:07.657885 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c6c89-ef11-4101-8928-8d4b0cbf1cd4 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:36:07.752947 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:36:07.762600 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c6c89-ef11-4101-8928-8d4b0cbf1cd4 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:36:07.796219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:36:07.797013 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:07.797302 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:07.797580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:07.798223 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:36:07.799630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 09:36:07.812339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 09:36:07.820732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application with Lock( Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self._enter() Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application return self.creator() Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application created_value = creator( Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: ERROR keystone.server.flask.application Jul 25 09:36:07.821761 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 462/925] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Jul 25 09:36:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 09:36:07.822805 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0613b-69fa-4c81-bf04-6ea1ebfaf529 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:36:07.897155 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:36:07.920905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0613b-69fa-4c81-bf04-6ea1ebfaf529 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:36:07.952737 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee83fc4-1427-479b-9e7d-20865049dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:36:07.953387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83fc4-1427-479b-9e7d-20865049dcba None admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:07.953675 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83fc4-1427-479b-9e7d-20865049dcba None admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:07.953951 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83fc4-1427-479b-9e7d-20865049dcba None admin] PATH_INFO: `/v3/services` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:07.954941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee83fc4-1427-479b-9e7d-20865049dcba None admin] RBAC: Adding query filter params (name=placement) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:36:07.955250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee83fc4-1427-479b-9e7d-20865049dcba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:36:07.956609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee83fc4-1427-479b-9e7d-20865049dcba None admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:36:07.962244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 464/926] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Jul 25 09:36:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:36:07.968343 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:36:08.065111 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d91d94-a3d9-4e5b-86b0-5edea954dea2 None admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:36:08.098189 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63797b9b-be7e-4532-87fb-4cfed88e6481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:36:08.098878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63797b9b-be7e-4532-87fb-4cfed88e6481 None admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:36:08.099171 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63797b9b-be7e-4532-87fb-4cfed88e6481 None admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:36:08.100060 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63797b9b-be7e-4532-87fb-4cfed88e6481 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:36:08.100811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63797b9b-be7e-4532-87fb-4cfed88e6481 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:36:08.102175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63797b9b-be7e-4532-87fb-4cfed88e6481 None admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:36:08.230385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 463/927] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:36:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:36:17.990633 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=30 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:36:18.225706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:43:16.054461 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ecd8-787c-4581-ad5d-44b43292ac10 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:16.055001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ecd8-787c-4581-ad5d-44b43292ac10 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:16.055096 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ecd8-787c-4581-ad5d-44b43292ac10 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:16.065224 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 465/928] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:16.067608 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca19afa-19ad-4bcc-a884-d48f0ab7bb0a None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:16.068533 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca19afa-19ad-4bcc-a884-d48f0ab7bb0a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:16.069541 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca19afa-19ad-4bcc-a884-d48f0ab7bb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:16.177974 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-6ca19afa-19ad-4bcc-a884-d48f0ab7bb0a None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:16.180477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-6ca19afa-19ad-4bcc-a884-d48f0ab7bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:16.313844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 464/929] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:16.367758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386d00-25e6-4aa6-8293-035351c8748d None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:16.368251 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386d00-25e6-4aa6-8293-035351c8748d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:16.368563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88386d00-25e6-4aa6-8293-035351c8748d None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:16.372686 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 466/930] 10.222.0.67 () {54 vars in 965 bytes} [Mon Jul 25 09:43:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:16.380263 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64992-6e29-4014-8694-5e1b19f2263e None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:16.380569 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64992-6e29-4014-8694-5e1b19f2263e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:16.380858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64992-6e29-4014-8694-5e1b19f2263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:16.449531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-18e64992-6e29-4014-8694-5e1b19f2263e None None] MFA Rules not processed for user `3969b99ab3b9410388d56dda5a4e15e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:16.450249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-18e64992-6e29-4014-8694-5e1b19f2263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:16.508935 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:43:16.549399 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 465/931] 10.222.0.67 () {58 vars in 1062 bytes} [Mon Jul 25 09:43:16 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:16.558117 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88386d00-25e6-4aa6-8293-035351c8748d None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:16.569065 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88386d00-25e6-4aa6-8293-035351c8748d None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:16.572836 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb75e65-7f57-4405-90b5-e5360f33bcf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:16.573469 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75e65-7f57-4405-90b5-e5360f33bcf5 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:16.573749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75e65-7f57-4405-90b5-e5360f33bcf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:16.574022 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75e65-7f57-4405-90b5-e5360f33bcf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:16.583304 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb75e65-7f57-4405-90b5-e5360f33bcf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:16.585876 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb75e65-7f57-4405-90b5-e5360f33bcf5 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:16.597387 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 467/932] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:19.067920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322012-4d46-4df8-b59e-633f34434f98 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:19.068484 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322012-4d46-4df8-b59e-633f34434f98 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:19.068484 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322012-4d46-4df8-b59e-633f34434f98 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:19.070396 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 466/933] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:19.075874 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9374e4-8d0d-4632-92c3-363a3cf2794c None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:19.076273 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9374e4-8d0d-4632-92c3-363a3cf2794c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:19.076495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9374e4-8d0d-4632-92c3-363a3cf2794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:19.096161 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-ef9374e4-8d0d-4632-92c3-363a3cf2794c None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:19.097384 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-ef9374e4-8d0d-4632-92c3-363a3cf2794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:19.105232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 468/934] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:19.144913 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322012-4d46-4df8-b59e-633f34434f98 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:19.156526 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322012-4d46-4df8-b59e-633f34434f98 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:19.160155 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639f32f-8e72-41af-930c-3a8f96e01ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:19.160793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f32f-8e72-41af-930c-3a8f96e01ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:19.161080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f32f-8e72-41af-930c-3a8f96e01ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:19.161358 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639f32f-8e72-41af-930c-3a8f96e01ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:19.170781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639f32f-8e72-41af-930c-3a8f96e01ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:19.172217 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639f32f-8e72-41af-930c-3a8f96e01ae2 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:19.181748 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 467/935] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:22.029094 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6cca-24f0-4ab0-b3c6-81698b8f50a4 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:22.029634 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6cca-24f0-4ab0-b3c6-81698b8f50a4 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:22.029634 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6cca-24f0-4ab0-b3c6-81698b8f50a4 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:22.031242 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 469/936] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:22.036177 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44baf1-7ff0-4540-a4a9-848fbd4e0a46 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:22.036578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44baf1-7ff0-4540-a4a9-848fbd4e0a46 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:22.036758 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44baf1-7ff0-4540-a4a9-848fbd4e0a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:22.096613 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-3f44baf1-7ff0-4540-a4a9-848fbd4e0a46 None None] MFA Rules not processed for user `d7bdcb82cda748ea91e11af6871a68bf`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:22.097797 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-3f44baf1-7ff0-4540-a4a9-848fbd4e0a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:22.184275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 468/937] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:22 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:22.225709 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb6cca-24f0-4ab0-b3c6-81698b8f50a4 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:22.236558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb6cca-24f0-4ab0-b3c6-81698b8f50a4 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:22.239990 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42f01a-2712-4a58-bfdd-e5b97393856f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:22.240632 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42f01a-2712-4a58-bfdd-e5b97393856f service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:22.241444 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42f01a-2712-4a58-bfdd-e5b97393856f service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:22.241716 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42f01a-2712-4a58-bfdd-e5b97393856f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:22.251230 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42f01a-2712-4a58-bfdd-e5b97393856f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:22.252671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42f01a-2712-4a58-bfdd-e5b97393856f service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:22.263261 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 470/938] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:22 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:25.546699 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb2b62-85c4-408d-a4b5-98f88f22482d None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:25.547222 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb2b62-85c4-408d-a4b5-98f88f22482d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:25.547313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb2b62-85c4-408d-a4b5-98f88f22482d None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:25.548700 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 469/939] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:25.554134 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ae07-cfc7-4ef4-bc64-a56448365d66 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:25.554593 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ae07-cfc7-4ef4-bc64-a56448365d66 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:25.554727 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ae07-cfc7-4ef4-bc64-a56448365d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:25.573909 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-45a0ae07-cfc7-4ef4-bc64-a56448365d66 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:25.575146 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-45a0ae07-cfc7-4ef4-bc64-a56448365d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:25.642209 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 471/940] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:25 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:25.681796 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb2b62-85c4-408d-a4b5-98f88f22482d None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:25.692171 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb2b62-85c4-408d-a4b5-98f88f22482d None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:25.696361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10e9f8-da02-4a99-b8f7-489db86de362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:25.696988 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e9f8-da02-4a99-b8f7-489db86de362 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:25.697513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e9f8-da02-4a99-b8f7-489db86de362 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:25.697794 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e9f8-da02-4a99-b8f7-489db86de362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:25.706441 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10e9f8-da02-4a99-b8f7-489db86de362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:25.707892 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10e9f8-da02-4a99-b8f7-489db86de362 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:25.717535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 470/941] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:25 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:29.015183 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f162-94fb-4478-8336-f7432aa99d31 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:29.015778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f162-94fb-4478-8336-f7432aa99d31 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:29.015778 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f162-94fb-4478-8336-f7432aa99d31 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:29.017177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 472/942] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:29.023350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dafd3b-d238-4557-acfc-84c27071f5bc None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:29.023786 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dafd3b-d238-4557-acfc-84c27071f5bc None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:29.023919 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dafd3b-d238-4557-acfc-84c27071f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:29.043847 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-01dafd3b-d238-4557-acfc-84c27071f5bc None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:29.051087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-01dafd3b-d238-4557-acfc-84c27071f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:29.053180 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 471/943] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:29.091325 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f162-94fb-4478-8336-f7432aa99d31 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:29.103086 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f162-94fb-4478-8336-f7432aa99d31 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:29.108270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ed06f-dc7a-46c8-a531-2615ea5e8592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:29.108270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed06f-dc7a-46c8-a531-2615ea5e8592 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:29.108270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed06f-dc7a-46c8-a531-2615ea5e8592 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:29.108270 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed06f-dc7a-46c8-a531-2615ea5e8592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:29.117045 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ed06f-dc7a-46c8-a531-2615ea5e8592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:29.118478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ed06f-dc7a-46c8-a531-2615ea5e8592 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:29.127905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 473/944] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:43:31.388590 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9961d-5a7d-451f-9910-55f3f62f19c7 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:31.389085 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9961d-5a7d-451f-9910-55f3f62f19c7 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:31.389206 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9961d-5a7d-451f-9910-55f3f62f19c7 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:31.390564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 472/945] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:31.395722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbcd51-4bb2-4c05-9ea9-88e811381f3a None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:31.396129 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbcd51-4bb2-4c05-9ea9-88e811381f3a None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:31.396286 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbcd51-4bb2-4c05-9ea9-88e811381f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:31.416506 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-96bbcd51-4bb2-4c05-9ea9-88e811381f3a None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:31.417699 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-96bbcd51-4bb2-4c05-9ea9-88e811381f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:31.425385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 474/946] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:31.462406 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9961d-5a7d-451f-9910-55f3f62f19c7 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:31.472998 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9961d-5a7d-451f-9910-55f3f62f19c7 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:31.477096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df9192-86ef-43a0-9c15-b47df43a278c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:31.477737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9192-86ef-43a0-9c15-b47df43a278c service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:31.478024 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9192-86ef-43a0-9c15-b47df43a278c service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:31.478302 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9192-86ef-43a0-9c15-b47df43a278c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:31.487350 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df9192-86ef-43a0-9c15-b47df43a278c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:31.488734 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df9192-86ef-43a0-9c15-b47df43a278c service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:31.498532 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 473/947] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:33.779277 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7484e9-d8f0-4a90-bf23-db5dab840f35 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:33.779869 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7484e9-d8f0-4a90-bf23-db5dab840f35 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:33.779869 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7484e9-d8f0-4a90-bf23-db5dab840f35 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:33.781223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 475/948] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:33.787250 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec9d5-9f47-48c1-9968-d42e302bb4e5 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:33.787809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec9d5-9f47-48c1-9968-d42e302bb4e5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:33.787809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec9d5-9f47-48c1-9968-d42e302bb4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:33.807600 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-804ec9d5-9f47-48c1-9968-d42e302bb4e5 None None] MFA Rules not processed for user `d7bdcb82cda748ea91e11af6871a68bf`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:33.808804 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-804ec9d5-9f47-48c1-9968-d42e302bb4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:33.816630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 474/949] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:33 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:33.872266 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f768b-2815-471a-91f2-44c9242988af None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:33.872637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f768b-2815-471a-91f2-44c9242988af None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:33.872990 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f768b-2815-471a-91f2-44c9242988af None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:33.874490 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 476/950] 10.222.0.67 () {54 vars in 965 bytes} [Mon Jul 25 09:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:33.880448 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c48a3-4e35-4f23-a432-f983bb5650ae None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:33.880739 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c48a3-4e35-4f23-a432-f983bb5650ae None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:33.881088 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c48a3-4e35-4f23-a432-f983bb5650ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:33.911191 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-4c0c48a3-4e35-4f23-a432-f983bb5650ae None None] MFA Rules not processed for user `3969b99ab3b9410388d56dda5a4e15e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:33.912873 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-4c0c48a3-4e35-4f23-a432-f983bb5650ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:33.919415 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 475/951] 10.222.0.67 () {58 vars in 1062 bytes} [Mon Jul 25 09:43:33 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:43:33.928768 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f768b-2815-471a-91f2-44c9242988af None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:33.939385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f768b-2815-471a-91f2-44c9242988af None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:33.942806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834496-f7f6-4935-b4f8-6a6d83f005c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:33.943496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834496-f7f6-4935-b4f8-6a6d83f005c1 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:33.943787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834496-f7f6-4935-b4f8-6a6d83f005c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:33.944069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834496-f7f6-4935-b4f8-6a6d83f005c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:33.953147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f834496-f7f6-4935-b4f8-6a6d83f005c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:33.954622 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f834496-f7f6-4935-b4f8-6a6d83f005c1 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:33.964134 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 477/952] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:33 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:37.002633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9253-ebc7-4c69-a9c1-cb29dc3842a5 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:37.003158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9253-ebc7-4c69-a9c1-cb29dc3842a5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:37.003158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9253-ebc7-4c69-a9c1-cb29dc3842a5 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:37.004595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 476/953] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:37.010526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded44c-2144-42d4-a11a-5066e24b66b3 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:37.010934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded44c-2144-42d4-a11a-5066e24b66b3 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:37.011223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ded44c-2144-42d4-a11a-5066e24b66b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:37.031125 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-d0ded44c-2144-42d4-a11a-5066e24b66b3 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:37.032306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-d0ded44c-2144-42d4-a11a-5066e24b66b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:37.040267 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 478/954] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:37.076764 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9253-ebc7-4c69-a9c1-cb29dc3842a5 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:37.083319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:43:37.088144 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9253-ebc7-4c69-a9c1-cb29dc3842a5 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:37.091725 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1bef3-5097-4413-870f-9f5d38d6aaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:37.092366 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1bef3-5097-4413-870f-9f5d38d6aaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:37.092652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1bef3-5097-4413-870f-9f5d38d6aaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:37.099773 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1bef3-5097-4413-870f-9f5d38d6aaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:37.102097 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1bef3-5097-4413-870f-9f5d38d6aaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:37.103552 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1bef3-5097-4413-870f-9f5d38d6aaa3 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:37.119648 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 477/955] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:39.391124 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafbbe3-3e18-41a2-9284-6849d34a8b0c None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:39.391651 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafbbe3-3e18-41a2-9284-6849d34a8b0c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:39.391651 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafbbe3-3e18-41a2-9284-6849d34a8b0c None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:39.393231 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 479/956] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:39.398824 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cd4b-cef6-49e4-9c4d-1b4c43f16ec3 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:39.399254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cd4b-cef6-49e4-9c4d-1b4c43f16ec3 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:39.400972 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cd4b-cef6-49e4-9c4d-1b4c43f16ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:39.418982 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-eeb5cd4b-cef6-49e4-9c4d-1b4c43f16ec3 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:39.420184 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-eeb5cd4b-cef6-49e4-9c4d-1b4c43f16ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:39.428760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 478/957] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:39.470426 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafbbe3-3e18-41a2-9284-6849d34a8b0c None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:39.476618 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=65 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:43:39.482983 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafbbe3-3e18-41a2-9284-6849d34a8b0c None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:39.487143 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f609-96f3-4781-a89e-954c5d63209b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:39.487852 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f609-96f3-4781-a89e-954c5d63209b service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:39.488086 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f609-96f3-4781-a89e-954c5d63209b service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:39.488367 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f609-96f3-4781-a89e-954c5d63209b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:39.499798 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f609-96f3-4781-a89e-954c5d63209b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:39.501257 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f609-96f3-4781-a89e-954c5d63209b service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:39.513321 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 480/958] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:42.362229 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77574-a40f-449d-b14a-6beea63dfca0 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:42.362740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77574-a40f-449d-b14a-6beea63dfca0 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:42.362850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77574-a40f-449d-b14a-6beea63dfca0 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:42.364219 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 479/959] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:42.369287 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32359cc-2938-490f-a244-b35ad54a85f5 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:42.369699 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32359cc-2938-490f-a244-b35ad54a85f5 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:42.369853 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32359cc-2938-490f-a244-b35ad54a85f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:42.389063 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-e32359cc-2938-490f-a244-b35ad54a85f5 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:42.390247 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-e32359cc-2938-490f-a244-b35ad54a85f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:42.398724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 481/960] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:42 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:42.434404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf77574-a40f-449d-b14a-6beea63dfca0 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:42.445719 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf77574-a40f-449d-b14a-6beea63dfca0 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:42.449382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeeeb7-264b-4274-b72f-8d78853f972d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:42.450016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeeeb7-264b-4274-b72f-8d78853f972d service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:42.450296 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeeeb7-264b-4274-b72f-8d78853f972d service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:42.450601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeeeb7-264b-4274-b72f-8d78853f972d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:42.460197 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeeeb7-264b-4274-b72f-8d78853f972d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:42.461612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeeeb7-264b-4274-b72f-8d78853f972d service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:42.470826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 480/961] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:42 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:46.893385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b4f1-724f-4a69-8c71-38c98099a88d None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:46.893894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b4f1-724f-4a69-8c71-38c98099a88d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:46.893991 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b4f1-724f-4a69-8c71-38c98099a88d None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:46.895393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 482/962] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:46.901556 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf80b7-1841-48bb-8b3c-076b56afc4db None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:46.901965 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf80b7-1841-48bb-8b3c-076b56afc4db None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:46.902276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf80b7-1841-48bb-8b3c-076b56afc4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:46.921145 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-deaf80b7-1841-48bb-8b3c-076b56afc4db None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:46.922428 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-deaf80b7-1841-48bb-8b3c-076b56afc4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:46.930420 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 481/963] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:46.971081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2b4f1-724f-4a69-8c71-38c98099a88d None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:46.981978 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2b4f1-724f-4a69-8c71-38c98099a88d None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:46.985430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae1ab2-9217-4baa-a395-edbae154d9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:46.986068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1ab2-9217-4baa-a395-edbae154d9fd service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:46.986359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1ab2-9217-4baa-a395-edbae154d9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:46.986685 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1ab2-9217-4baa-a395-edbae154d9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:46.996331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae1ab2-9217-4baa-a395-edbae154d9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:46.997765 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae1ab2-9217-4baa-a395-edbae154d9fd service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:47.013898 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 483/964] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:50.203835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2a1de-bf5b-42a0-841b-b8ca11db71c2 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:50.204341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2a1de-bf5b-42a0-841b-b8ca11db71c2 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:50.204341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2a1de-bf5b-42a0-841b-b8ca11db71c2 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:50.205810 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 482/965] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:50.211085 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebb9fe-7bf3-47df-9aa6-6771fe31f3aa None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:50.211496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebb9fe-7bf3-47df-9aa6-6771fe31f3aa None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:50.211776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebb9fe-7bf3-47df-9aa6-6771fe31f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:50.230765 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-7cebb9fe-7bf3-47df-9aa6-6771fe31f3aa None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:50.231978 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-7cebb9fe-7bf3-47df-9aa6-6771fe31f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:50.240440 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 484/966] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:50 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:50.279359 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2a1de-bf5b-42a0-841b-b8ca11db71c2 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:50.290717 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2a1de-bf5b-42a0-841b-b8ca11db71c2 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:50.294167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6ffb7-de41-414c-8736-c4cceaf0ae6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:50.294862 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ffb7-de41-414c-8736-c4cceaf0ae6f service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:50.300678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ffb7-de41-414c-8736-c4cceaf0ae6f service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:50.300678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6ffb7-de41-414c-8736-c4cceaf0ae6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:50.305136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6ffb7-de41-414c-8736-c4cceaf0ae6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:50.306596 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6ffb7-de41-414c-8736-c4cceaf0ae6f service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:50.315983 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 483/967] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:50 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:43:55.100135 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ae5c3-587c-4072-9a40-edfabc6a7f8d None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:55.100837 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ae5c3-587c-4072-9a40-edfabc6a7f8d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:55.100837 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ae5c3-587c-4072-9a40-edfabc6a7f8d None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:55.102125 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 485/968] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:43:55.107759 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29601ed-c271-4731-90ae-a4214c8e75e7 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:55.108213 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29601ed-c271-4731-90ae-a4214c8e75e7 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:55.108334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29601ed-c271-4731-90ae-a4214c8e75e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:55.128740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-f29601ed-c271-4731-90ae-a4214c8e75e7 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:43:55.129932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-f29601ed-c271-4731-90ae-a4214c8e75e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:43:55.138921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 484/969] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:43:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:43:55.180069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ae5c3-587c-4072-9a40-edfabc6a7f8d None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:43:55.190903 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ae5c3-587c-4072-9a40-edfabc6a7f8d None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:43:55.194635 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389b908-f834-4c88-837e-163b85b78f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:43:55.195367 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389b908-f834-4c88-837e-163b85b78f32 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:43:55.195656 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389b908-f834-4c88-837e-163b85b78f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:43:55.195939 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389b908-f834-4c88-837e-163b85b78f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:43:55.206154 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389b908-f834-4c88-837e-163b85b78f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:43:55.212099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389b908-f834-4c88-837e-163b85b78f32 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:43:55.217424 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 486/970] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:43:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:00.768259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2005b-3bf7-4164-bc81-5d15e6bd15d7 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:00.768739 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2005b-3bf7-4164-bc81-5d15e6bd15d7 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:00.768843 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2005b-3bf7-4164-bc81-5d15e6bd15d7 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:00.770148 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 485/971] 10.222.0.67 () {54 vars in 921 bytes} [Mon Jul 25 09:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:00.776151 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ecf99-f392-4a8f-b6e5-a1109b818c27 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:00.776563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ecf99-f392-4a8f-b6e5-a1109b818c27 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:00.777111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ecf99-f392-4a8f-b6e5-a1109b818c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:00.830359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-7e1ecf99-f392-4a8f-b6e5-a1109b818c27 None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:00.832841 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-7e1ecf99-f392-4a8f-b6e5-a1109b818c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:00.937625 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 487/972] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Jul 25 09:44:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:05.123549 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=25 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:44:05.472989 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b473f-292f-48aa-b8a6-6a94a1d5fc0e None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:05.473332 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b473f-292f-48aa-b8a6-6a94a1d5fc0e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:05.474094 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b473f-292f-48aa-b8a6-6a94a1d5fc0e None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:05.475730 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 486/973] 10.222.0.67 () {54 vars in 921 bytes} [Mon Jul 25 09:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:05.480879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412678be-6092-4e64-a062-f20c6617bd12 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:05.481393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412678be-6092-4e64-a062-f20c6617bd12 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:05.481474 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412678be-6092-4e64-a062-f20c6617bd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:05.504161 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-412678be-6092-4e64-a062-f20c6617bd12 None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:05.505574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-412678be-6092-4e64-a062-f20c6617bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:05.514718 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 488/974] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Jul 25 09:44:05 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:07.031999 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ccda5-0dde-4572-93ac-258c8ca6d100 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:07.031999 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ccda5-0dde-4572-93ac-258c8ca6d100 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:07.031999 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ccda5-0dde-4572-93ac-258c8ca6d100 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:07.032768 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 487/975] 10.222.0.67 () {54 vars in 921 bytes} [Mon Jul 25 09:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:07.037897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21591ac-1157-4017-9713-0b540b4fa5d0 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:07.038368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21591ac-1157-4017-9713-0b540b4fa5d0 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:07.038482 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21591ac-1157-4017-9713-0b540b4fa5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:07.057863 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-a21591ac-1157-4017-9713-0b540b4fa5d0 None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:07.059101 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-a21591ac-1157-4017-9713-0b540b4fa5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:07.068813 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 489/976] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Jul 25 09:44:07 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:11.070630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e300c-6ba4-4375-9e0c-62b7802e8c3d None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:11.071237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e300c-6ba4-4375-9e0c-62b7802e8c3d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:11.071237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e300c-6ba4-4375-9e0c-62b7802e8c3d None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:11.072780 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 488/977] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:11.078036 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e99c-c25b-4a17-82ea-174813b50e61 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:11.078456 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e99c-c25b-4a17-82ea-174813b50e61 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:11.078648 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0e99c-c25b-4a17-82ea-174813b50e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:11.086681 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=69 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:44:11.099745 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-75c0e99c-c25b-4a17-82ea-174813b50e61 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:11.100929 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-75c0e99c-c25b-4a17-82ea-174813b50e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:11.109093 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 490/978] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:11.166651 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8e4d-f3f3-402c-aa45-5fee13927ee4 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:11.167198 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8e4d-f3f3-402c-aa45-5fee13927ee4 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:11.170742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8e4d-f3f3-402c-aa45-5fee13927ee4 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:11.170742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 489/979] 10.222.0.67 () {54 vars in 962 bytes} [Mon Jul 25 09:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:11.176306 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5969-4a65-43ce-9259-b5bb6f786b37 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:11.176636 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5969-4a65-43ce-9259-b5bb6f786b37 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:11.177108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5969-4a65-43ce-9259-b5bb6f786b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:11.232668 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-5d4a5969-4a65-43ce-9259-b5bb6f786b37 None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:11.233907 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-5d4a5969-4a65-43ce-9259-b5bb6f786b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:11.314640 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 491/980] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Jul 25 09:44:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:44:11.329181 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8e4d-f3f3-402c-aa45-5fee13927ee4 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:11.338689 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8e4d-f3f3-402c-aa45-5fee13927ee4 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:11.343707 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071d848-1409-4d8d-baf0-7c5499cb421e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:11.344784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d848-1409-4d8d-baf0-7c5499cb421e service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:11.345236 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d848-1409-4d8d-baf0-7c5499cb421e service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:11.345519 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071d848-1409-4d8d-baf0-7c5499cb421e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:11.354401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071d848-1409-4d8d-baf0-7c5499cb421e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:11.357903 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071d848-1409-4d8d-baf0-7c5499cb421e service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:11.366226 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 490/981] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:13.827203 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5cbcc-6b57-4b17-829a-75eb8b4f6327 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:13.839886 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5cbcc-6b57-4b17-829a-75eb8b4f6327 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:13.839886 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5cbcc-6b57-4b17-829a-75eb8b4f6327 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:13.839886 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 492/982] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:13.840164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5bd2-208c-4aef-affc-505e6ed69dfa None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:13.840164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5bd2-208c-4aef-affc-505e6ed69dfa None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:13.840164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5bd2-208c-4aef-affc-505e6ed69dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:13.855468 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-637d5bd2-208c-4aef-affc-505e6ed69dfa None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:13.856672 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-637d5bd2-208c-4aef-affc-505e6ed69dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:13.864997 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 491/983] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:13.911046 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5cbcc-6b57-4b17-829a-75eb8b4f6327 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:13.924470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5cbcc-6b57-4b17-829a-75eb8b4f6327 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:13.929496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fa0f2-fa4c-4727-a675-bdc1a6b64012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:13.930148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fa0f2-fa4c-4727-a675-bdc1a6b64012 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:13.930437 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fa0f2-fa4c-4727-a675-bdc1a6b64012 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:13.930750 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fa0f2-fa4c-4727-a675-bdc1a6b64012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:13.941476 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fa0f2-fa4c-4727-a675-bdc1a6b64012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:13.941646 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fa0f2-fa4c-4727-a675-bdc1a6b64012 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:13.952691 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 493/984] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:16.692894 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2b3a-2e54-43d2-88aa-b1ad174adc8a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:16.693983 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2b3a-2e54-43d2-88aa-b1ad174adc8a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:16.694515 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2b3a-2e54-43d2-88aa-b1ad174adc8a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:16.698582 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 492/985] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:16.703157 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2af64-a68d-4b92-8506-8a0e315a518d None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:16.704005 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2af64-a68d-4b92-8506-8a0e315a518d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:16.704423 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2af64-a68d-4b92-8506-8a0e315a518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:16.727018 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-23a2af64-a68d-4b92-8506-8a0e315a518d None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:16.728146 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-23a2af64-a68d-4b92-8506-8a0e315a518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:16.736026 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 494/986] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:16.783568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ca72-1a9a-4420-b171-de779bc5123e None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:16.783947 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ca72-1a9a-4420-b171-de779bc5123e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:16.784302 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ca72-1a9a-4420-b171-de779bc5123e None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:16.786561 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 493/987] 10.222.0.67 () {54 vars in 962 bytes} [Mon Jul 25 09:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:16.792265 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbca13-eaa3-4a9f-9ed8-1349838d41ea None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:16.792562 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbca13-eaa3-4a9f-9ed8-1349838d41ea None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:16.792849 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbca13-eaa3-4a9f-9ed8-1349838d41ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:16.813038 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-97dbca13-eaa3-4a9f-9ed8-1349838d41ea None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:16.814225 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-97dbca13-eaa3-4a9f-9ed8-1349838d41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:16.823342 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 495/988] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Jul 25 09:44:16 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:44:16.831180 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2ca72-1a9a-4420-b171-de779bc5123e None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:16.845208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2ca72-1a9a-4420-b171-de779bc5123e None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:16.851126 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76622ad-62b2-48be-bc4b-68b21aa5ce79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:16.851774 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76622ad-62b2-48be-bc4b-68b21aa5ce79 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:16.852101 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76622ad-62b2-48be-bc4b-68b21aa5ce79 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:16.852383 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76622ad-62b2-48be-bc4b-68b21aa5ce79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:16.860629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76622ad-62b2-48be-bc4b-68b21aa5ce79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:16.862209 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76622ad-62b2-48be-bc4b-68b21aa5ce79 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:16.872478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 494/989] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:19.381694 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750c2eb-e723-455b-a2c1-a0e3433bd213 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:19.382240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750c2eb-e723-455b-a2c1-a0e3433bd213 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:19.382240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750c2eb-e723-455b-a2c1-a0e3433bd213 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:19.383674 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 496/990] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:19.388785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b2e1-ff82-4d66-93a9-69bbb8b36bb1 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:19.389594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b2e1-ff82-4d66-93a9-69bbb8b36bb1 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:19.390043 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b2e1-ff82-4d66-93a9-69bbb8b36bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:19.411828 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-0e62b2e1-ff82-4d66-93a9-69bbb8b36bb1 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:19.413527 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-0e62b2e1-ff82-4d66-93a9-69bbb8b36bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:19.426994 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 495/991] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:19.469122 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750c2eb-e723-455b-a2c1-a0e3433bd213 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:19.484153 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750c2eb-e723-455b-a2c1-a0e3433bd213 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:19.489512 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57576c11-2a88-4e7c-83b8-7452d2510533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:19.490385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576c11-2a88-4e7c-83b8-7452d2510533 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:19.490922 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576c11-2a88-4e7c-83b8-7452d2510533 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:19.491398 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576c11-2a88-4e7c-83b8-7452d2510533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:19.500505 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57576c11-2a88-4e7c-83b8-7452d2510533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:19.502479 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57576c11-2a88-4e7c-83b8-7452d2510533 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:19.518457 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 497/992] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:21.148917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1278-28d2-4919-a80e-9939e0afd2aa None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:21.149353 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1278-28d2-4919-a80e-9939e0afd2aa None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:21.149630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1278-28d2-4919-a80e-9939e0afd2aa None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:21.163786 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 496/993] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:21.166451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a3c1-e6cc-49f4-94f1-8d1bdf6acee3 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:21.166904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a3c1-e6cc-49f4-94f1-8d1bdf6acee3 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:21.167503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607a3c1-e6cc-49f4-94f1-8d1bdf6acee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:21.206161 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-9607a3c1-e6cc-49f4-94f1-8d1bdf6acee3 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:21.209391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-9607a3c1-e6cc-49f4-94f1-8d1bdf6acee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:21.233190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 498/994] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:21.575687 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d17456-94b6-4397-9075-95cc460ccc50 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:21.575687 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d17456-94b6-4397-9075-95cc460ccc50 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:21.575687 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d17456-94b6-4397-9075-95cc460ccc50 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:21.578517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 497/995] 10.222.0.67 () {54 vars in 964 bytes} [Mon Jul 25 09:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:21.584792 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b9e7-2be8-496a-a043-dbb996641a70 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:21.585526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b9e7-2be8-496a-a043-dbb996641a70 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:21.585882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b9e7-2be8-496a-a043-dbb996641a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:21.645368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-fb08b9e7-2be8-496a-a043-dbb996641a70 None None] MFA Rules not processed for user `362c7977a3564cc1a9c0ff0f0dcc6df6`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:21.647910 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-fb08b9e7-2be8-496a-a043-dbb996641a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:21.699621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=100 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:44:21.717125 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 499/996] 10.222.0.67 () {58 vars in 1061 bytes} [Mon Jul 25 09:44:21 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:21.725263 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d17456-94b6-4397-9075-95cc460ccc50 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:21.736564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d17456-94b6-4397-9075-95cc460ccc50 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:21.740827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ce796-eee3-434c-90fe-5391ed6540b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c7977a3564cc1a9c0ff0f0dcc6df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:21.741478 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce796-eee3-434c-90fe-5391ed6540b5 service cinder] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:21.741765 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce796-eee3-434c-90fe-5391ed6540b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:21.742044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce796-eee3-434c-90fe-5391ed6540b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:21.751827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ce796-eee3-434c-90fe-5391ed6540b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:21.753264 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ce796-eee3-434c-90fe-5391ed6540b5 service cinder] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:21.765129 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 498/997] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:22.014181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1ef4-c22b-42e9-a13d-bf5677ec6c43 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:22.014488 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1ef4-c22b-42e9-a13d-bf5677ec6c43 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:22.014780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1ef4-c22b-42e9-a13d-bf5677ec6c43 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:22.016444 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 500/998] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:22.022169 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fcf32-0a84-4bfb-b54c-857e75b5c8b2 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:22.022462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fcf32-0a84-4bfb-b54c-857e75b5c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:22.022772 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fcf32-0a84-4bfb-b54c-857e75b5c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:22.041841 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-038fcf32-0a84-4bfb-b54c-857e75b5c8b2 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:22.043070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-038fcf32-0a84-4bfb-b54c-857e75b5c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:22.054727 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 499/999] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:22.097947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1ef4-c22b-42e9-a13d-bf5677ec6c43 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:22.112148 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1ef4-c22b-42e9-a13d-bf5677ec6c43 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:22.117317 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6a8f5-4d92-47b9-987c-3465f7be904e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:22.117962 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6a8f5-4d92-47b9-987c-3465f7be904e service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:22.118247 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6a8f5-4d92-47b9-987c-3465f7be904e service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:22.118567 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6a8f5-4d92-47b9-987c-3465f7be904e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:22.127366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6a8f5-4d92-47b9-987c-3465f7be904e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:22.128897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6a8f5-4d92-47b9-987c-3465f7be904e service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:22.139718 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 501/1000] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:24.533601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ea32d-bbd9-429a-80d4-2e8d600b62f8 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:24.534017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ea32d-bbd9-429a-80d4-2e8d600b62f8 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:24.534188 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ea32d-bbd9-429a-80d4-2e8d600b62f8 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:24.535726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 500/1001] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:24.541132 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16b1f6-9a8a-428c-beae-5d00f1af7a8e None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:24.541533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16b1f6-9a8a-428c-beae-5d00f1af7a8e None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:24.541688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16b1f6-9a8a-428c-beae-5d00f1af7a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:24.561131 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-ec16b1f6-9a8a-428c-beae-5d00f1af7a8e None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:24.562324 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-ec16b1f6-9a8a-428c-beae-5d00f1af7a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:24.576766 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 502/1002] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:24.618595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ea32d-bbd9-429a-80d4-2e8d600b62f8 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:24.638943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ea32d-bbd9-429a-80d4-2e8d600b62f8 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:24.643632 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb7fda-a024-43c8-800b-ab3d303cddad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:24.644292 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb7fda-a024-43c8-800b-ab3d303cddad service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:24.644582 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb7fda-a024-43c8-800b-ab3d303cddad service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:24.645400 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb7fda-a024-43c8-800b-ab3d303cddad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:24.654832 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb7fda-a024-43c8-800b-ab3d303cddad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:24.656354 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb7fda-a024-43c8-800b-ab3d303cddad service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:24.666873 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 501/1003] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:27.042972 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09208-ec76-4b1a-85ca-96c215232b95 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:27.043544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09208-ec76-4b1a-85ca-96c215232b95 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:27.043544 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b09208-ec76-4b1a-85ca-96c215232b95 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:27.044938 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 503/1004] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:27.050419 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa99d4-5378-4a2c-a526-23251aca6909 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:27.050853 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa99d4-5378-4a2c-a526-23251aca6909 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:27.051678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa99d4-5378-4a2c-a526-23251aca6909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:27.071585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-faaa99d4-5378-4a2c-a526-23251aca6909 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:27.073320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-faaa99d4-5378-4a2c-a526-23251aca6909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:27.082987 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 502/1005] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:27.124929 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b09208-ec76-4b1a-85ca-96c215232b95 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:27.139375 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b09208-ec76-4b1a-85ca-96c215232b95 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:27.144466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07ed9c-c047-4759-a441-960f8c210729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:27.145319 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ed9c-c047-4759-a441-960f8c210729 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:27.145772 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ed9c-c047-4759-a441-960f8c210729 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:27.146204 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07ed9c-c047-4759-a441-960f8c210729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:27.155883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07ed9c-c047-4759-a441-960f8c210729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:27.158933 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07ed9c-c047-4759-a441-960f8c210729 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:27.168998 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 504/1006] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:29.514579 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593caf2-22d3-4a11-8c7b-733fe412676b None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:29.515175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593caf2-22d3-4a11-8c7b-733fe412676b None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:29.515175 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593caf2-22d3-4a11-8c7b-733fe412676b None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:29.516497 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 503/1007] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:29.522536 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e92ae-50e6-4730-8f4f-ad73a13bc925 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:29.522962 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e92ae-50e6-4730-8f4f-ad73a13bc925 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:29.523048 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e92ae-50e6-4730-8f4f-ad73a13bc925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:29.543745 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-a23e92ae-50e6-4730-8f4f-ad73a13bc925 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:29.545153 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-a23e92ae-50e6-4730-8f4f-ad73a13bc925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:29.554688 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 505/1008] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:44:29.605006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593caf2-22d3-4a11-8c7b-733fe412676b None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:29.619815 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593caf2-22d3-4a11-8c7b-733fe412676b None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:29.625776 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fb053-d715-4b93-acaf-c26f3810ab77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:29.626629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fb053-d715-4b93-acaf-c26f3810ab77 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:29.626976 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fb053-d715-4b93-acaf-c26f3810ab77 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:29.627342 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fb053-d715-4b93-acaf-c26f3810ab77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:29.642417 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fb053-d715-4b93-acaf-c26f3810ab77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:29.646612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fb053-d715-4b93-acaf-c26f3810ab77 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:29.658146 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 504/1009] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:32.096951 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0296b-a76d-46c0-bd3e-9ed41c4054b0 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:32.108130 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0296b-a76d-46c0-bd3e-9ed41c4054b0 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:32.108130 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0296b-a76d-46c0-bd3e-9ed41c4054b0 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:32.108130 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 506/1010] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:32.108584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c2d9-6576-4411-9e25-d687993cf7f0 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:32.108584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c2d9-6576-4411-9e25-d687993cf7f0 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:32.108584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c2d9-6576-4411-9e25-d687993cf7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:32.131136 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-d4b8c2d9-6576-4411-9e25-d687993cf7f0 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:32.132811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-d4b8c2d9-6576-4411-9e25-d687993cf7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:32.144828 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 505/1011] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:32.191322 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0296b-a76d-46c0-bd3e-9ed41c4054b0 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:32.210220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0296b-a76d-46c0-bd3e-9ed41c4054b0 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:32.215155 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fc8de-cd54-4f06-93fc-033e1bd9dd9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:32.215797 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc8de-cd54-4f06-93fc-033e1bd9dd9c service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:32.216077 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc8de-cd54-4f06-93fc-033e1bd9dd9c service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:32.216350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc8de-cd54-4f06-93fc-033e1bd9dd9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:32.225445 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fc8de-cd54-4f06-93fc-033e1bd9dd9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:32.227081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fc8de-cd54-4f06-93fc-033e1bd9dd9c service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:32.240762 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 507/1012] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:35.353971 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040180b-383d-47d4-a539-7e44ce5ea899 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:35.354601 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040180b-383d-47d4-a539-7e44ce5ea899 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:35.354858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040180b-383d-47d4-a539-7e44ce5ea899 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:35.356699 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 506/1013] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:35.363380 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad332-f874-4d5c-840e-c6fedcbe6426 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:35.363855 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad332-f874-4d5c-840e-c6fedcbe6426 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:35.364001 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad332-f874-4d5c-840e-c6fedcbe6426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:35.387355 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-79aad332-f874-4d5c-840e-c6fedcbe6426 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:35.388580 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-79aad332-f874-4d5c-840e-c6fedcbe6426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:35.399126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 508/1014] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:35.458961 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040180b-383d-47d4-a539-7e44ce5ea899 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:35.466958 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=46 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:44:35.474970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040180b-383d-47d4-a539-7e44ce5ea899 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:35.481511 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5115f-8fc0-4b44-96c6-017d363b309c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:35.482376 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5115f-8fc0-4b44-96c6-017d363b309c service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:35.482896 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5115f-8fc0-4b44-96c6-017d363b309c service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:35.483301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5115f-8fc0-4b44-96c6-017d363b309c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:35.494439 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5115f-8fc0-4b44-96c6-017d363b309c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:35.496087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5115f-8fc0-4b44-96c6-017d363b309c service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:35.507150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 507/1015] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:38.438210 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72f1f-5815-41d9-9f7e-aaa03ddd5e12 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:38.438861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516f84-94dc-4ce9-a47a-288f061537ec None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:38.439267 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72f1f-5815-41d9-9f7e-aaa03ddd5e12 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:38.439382 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516f84-94dc-4ce9-a47a-288f061537ec None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:38.439485 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc72f1f-5815-41d9-9f7e-aaa03ddd5e12 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:38.439618 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c516f84-94dc-4ce9-a47a-288f061537ec None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:38.440192 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 509/1016] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:38.440633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 508/1017] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:38.445758 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156ead1-4f6f-430d-bce7-5cf638de9da4 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:38.445904 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98e8f7-2848-474e-a4ef-6717e6041e67 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:38.446050 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156ead1-4f6f-430d-bce7-5cf638de9da4 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:38.446493 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98e8f7-2848-474e-a4ef-6717e6041e67 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:38.446647 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156ead1-4f6f-430d-bce7-5cf638de9da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:38.446785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98e8f7-2848-474e-a4ef-6717e6041e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:38.468014 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-d156ead1-4f6f-430d-bce7-5cf638de9da4 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:38.468352 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-ed98e8f7-2848-474e-a4ef-6717e6041e67 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:38.469229 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-d156ead1-4f6f-430d-bce7-5cf638de9da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:38.469528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-ed98e8f7-2848-474e-a4ef-6717e6041e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:38.477353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 510/1018] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:38.477917 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 509/1019] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:44:38.526625 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156ead1-4f6f-430d-bce7-5cf638de9da4 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:38.535835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22313-0321-45a0-bdd3-78c67b6eba6a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:38.536128 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22313-0321-45a0-bdd3-78c67b6eba6a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:38.536418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22313-0321-45a0-bdd3-78c67b6eba6a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:38.537908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 510/1020] 10.222.0.67 () {54 vars in 966 bytes} [Mon Jul 25 09:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:44:38.538233 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156ead1-4f6f-430d-bce7-5cf638de9da4 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:38.542962 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c99a-bcd0-40e6-8643-dbe13367fd9f None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:38.543326 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c99a-bcd0-40e6-8643-dbe13367fd9f None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:38.543526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df63c2-8785-4407-91c1-cb5913ea3df1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:38.543659 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c99a-bcd0-40e6-8643-dbe13367fd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:38.544165 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df63c2-8785-4407-91c1-cb5913ea3df1 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:38.544449 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df63c2-8785-4407-91c1-cb5913ea3df1 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:38.544729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df63c2-8785-4407-91c1-cb5913ea3df1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:38.556394 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df63c2-8785-4407-91c1-cb5913ea3df1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:38.558023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df63c2-8785-4407-91c1-cb5913ea3df1 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:38.568523 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 511/1021] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:38.598335 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-8f21c99a-bcd0-40e6-8643-dbe13367fd9f None None] MFA Rules not processed for user `1a17097c198d491198553e03fd8e8327`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:38.599528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-8f21c99a-bcd0-40e6-8643-dbe13367fd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:38.659692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 511/1022] 10.222.0.67 () {58 vars in 1063 bytes} [Mon Jul 25 09:44:38 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:44:38.667533 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df63c2-8785-4407-91c1-cb5913ea3df1 service nova] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:38.677182 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df63c2-8785-4407-91c1-cb5913ea3df1 service nova] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:38.681071 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa12309-4ab7-477f-b4f0-fdce20209b17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17097c198d491198553e03fd8e8327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:38.681713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa12309-4ab7-477f-b4f0-fdce20209b17 service glance] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:38.682000 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa12309-4ab7-477f-b4f0-fdce20209b17 service glance] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:38.682281 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa12309-4ab7-477f-b4f0-fdce20209b17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:38.692559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa12309-4ab7-477f-b4f0-fdce20209b17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:38.694029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa12309-4ab7-477f-b4f0-fdce20209b17 service glance] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:38.703941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 512/1023] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:44:41.062679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5350677-8ef8-4ffc-9c26-a30b0e8a5592 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:41.063318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5350677-8ef8-4ffc-9c26-a30b0e8a5592 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:41.063318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5350677-8ef8-4ffc-9c26-a30b0e8a5592 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:41.064732 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 512/1024] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:41.071355 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d814a-2cb6-4689-a691-d0311aff906b None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:41.074553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d814a-2cb6-4689-a691-d0311aff906b None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:41.074553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d814a-2cb6-4689-a691-d0311aff906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:41.091177 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-9d7d814a-2cb6-4689-a691-d0311aff906b None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:41.092412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-9d7d814a-2cb6-4689-a691-d0311aff906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:41.100617 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 513/1025] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:44:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:41.147085 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5350677-8ef8-4ffc-9c26-a30b0e8a5592 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:41.160879 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5350677-8ef8-4ffc-9c26-a30b0e8a5592 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:41.166776 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d8c7f-de37-4339-94a6-183e10340e19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:41.167440 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8c7f-de37-4339-94a6-183e10340e19 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:41.167749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8c7f-de37-4339-94a6-183e10340e19 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:41.168032 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8c7f-de37-4339-94a6-183e10340e19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:41.177494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d8c7f-de37-4339-94a6-183e10340e19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:41.179140 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d8c7f-de37-4339-94a6-183e10340e19 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:41.189954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 513/1026] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:51.086222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=50 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:44:51.185424 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=52 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:44:54.538416 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46477-9af5-4f71-bd6e-07e97d6a587c None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:54.539024 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46477-9af5-4f71-bd6e-07e97d6a587c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:54.539024 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e46477-9af5-4f71-bd6e-07e97d6a587c None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:54.540391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 514/1027] 10.222.0.67 () {54 vars in 918 bytes} [Mon Jul 25 09:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:54.545574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231682-e7e1-4f24-a69b-2376d32b4f03 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:54.546001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231682-e7e1-4f24-a69b-2376d32b4f03 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:54.546126 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231682-e7e1-4f24-a69b-2376d32b4f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:54.566547 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-fe231682-e7e1-4f24-a69b-2376d32b4f03 None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:54.567746 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-fe231682-e7e1-4f24-a69b-2376d32b4f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:54.576941 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 514/1028] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Jul 25 09:44:54 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:54.590873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb95f-ec8a-49ee-af20-9c24e08a1c44 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:54.591110 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb95f-ec8a-49ee-af20-9c24e08a1c44 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:54.591423 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bb95f-ec8a-49ee-af20-9c24e08a1c44 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:54.592761 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 515/1029] 10.222.0.67 () {54 vars in 918 bytes} [Mon Jul 25 09:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:54.597301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0f47-d66e-4740-9f3d-45085b08cd8c None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:54.597591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0f47-d66e-4740-9f3d-45085b08cd8c None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:54.597869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0f47-d66e-4740-9f3d-45085b08cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:54.617297 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-734d0f47-d66e-4740-9f3d-45085b08cd8c None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:54.618513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-734d0f47-d66e-4740-9f3d-45085b08cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:54.627042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 515/1030] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Jul 25 09:44:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:44:57.365368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683449d-c639-4e65-8c79-795e48664276 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:57.365947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683449d-c639-4e65-8c79-795e48664276 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:57.365947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683449d-c639-4e65-8c79-795e48664276 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:57.367344 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 516/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:57.372581 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae5db-672d-4839-8309-d1ae6707c889 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:57.373050 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae5db-672d-4839-8309-d1ae6707c889 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:57.373156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae5db-672d-4839-8309-d1ae6707c889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:57.391978 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-b59ae5db-672d-4839-8309-d1ae6707c889 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:57.393172 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-b59ae5db-672d-4839-8309-d1ae6707c889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:57.401035 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 516/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:44:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:57.445206 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683449d-c639-4e65-8c79-795e48664276 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:57.458524 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683449d-c639-4e65-8c79-795e48664276 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:57.463379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b9eb1-e2a8-4eb8-9289-02072e3af20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:57.464016 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9eb1-e2a8-4eb8-9289-02072e3af20b service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:57.464296 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9eb1-e2a8-4eb8-9289-02072e3af20b service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:57.464569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b9eb1-e2a8-4eb8-9289-02072e3af20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:57.473069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b9eb1-e2a8-4eb8-9289-02072e3af20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:57.474695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b9eb1-e2a8-4eb8-9289-02072e3af20b service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:57.484662 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 517/1033] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:58.444780 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e555-460f-4ec5-8314-6e65bb939fb5 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:58.445328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e555-460f-4ec5-8314-6e65bb939fb5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:58.445328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e555-460f-4ec5-8314-6e65bb939fb5 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:58.447047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 517/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:58.451908 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd16d-458e-4571-96f9-53ece8637f8c None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:58.452308 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd16d-458e-4571-96f9-53ece8637f8c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:58.452477 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd16d-458e-4571-96f9-53ece8637f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:58.472156 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-f06cd16d-458e-4571-96f9-53ece8637f8c None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:58.473901 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-f06cd16d-458e-4571-96f9-53ece8637f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:58.481806 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 518/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:44:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:58.661388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e555-460f-4ec5-8314-6e65bb939fb5 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:58.674856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e555-460f-4ec5-8314-6e65bb939fb5 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:58.679828 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785f980-a96e-4d30-a1ea-8888e0f228e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:58.681964 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785f980-a96e-4d30-a1ea-8888e0f228e5 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:58.681964 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785f980-a96e-4d30-a1ea-8888e0f228e5 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:58.681964 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785f980-a96e-4d30-a1ea-8888e0f228e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:58.689078 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785f980-a96e-4d30-a1ea-8888e0f228e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:58.691282 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785f980-a96e-4d30-a1ea-8888e0f228e5 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:58.701117 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 518/1036] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:44:59.597911 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf08db-e7c3-49a6-b214-7a1b8b47913d None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:59.598511 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf08db-e7c3-49a6-b214-7a1b8b47913d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:59.598511 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf08db-e7c3-49a6-b214-7a1b8b47913d None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:59.599817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 519/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:44:59.604757 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daffda7-5656-47b5-be95-e0e00ef63ed7 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:59.605171 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daffda7-5656-47b5-be95-e0e00ef63ed7 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:59.605322 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daffda7-5656-47b5-be95-e0e00ef63ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:59.624416 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-6daffda7-5656-47b5-be95-e0e00ef63ed7 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:44:59.625600 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-6daffda7-5656-47b5-be95-e0e00ef63ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:44:59.634106 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 519/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:44:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:44:59.791285 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf08db-e7c3-49a6-b214-7a1b8b47913d None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:44:59.805637 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf08db-e7c3-49a6-b214-7a1b8b47913d None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:44:59.810635 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a88ae-7302-46c2-af57-d573c16c5317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:44:59.811403 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a88ae-7302-46c2-af57-d573c16c5317 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:44:59.811695 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a88ae-7302-46c2-af57-d573c16c5317 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:44:59.811976 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a88ae-7302-46c2-af57-d573c16c5317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:44:59.821156 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a88ae-7302-46c2-af57-d573c16c5317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:44:59.822810 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a88ae-7302-46c2-af57-d573c16c5317 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:44:59.832972 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 520/1039] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:44:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:00.717185 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea09ad5-6ca4-445f-80f6-a7b72c291861 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:00.717713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea09ad5-6ca4-445f-80f6-a7b72c291861 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:00.717713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea09ad5-6ca4-445f-80f6-a7b72c291861 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:00.719108 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 520/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:00.724638 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482092-7858-4699-91f1-4a39f5083a67 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:00.725039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482092-7858-4699-91f1-4a39f5083a67 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:00.725213 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482092-7858-4699-91f1-4a39f5083a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:00.744350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-3f482092-7858-4699-91f1-4a39f5083a67 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:00.745548 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-3f482092-7858-4699-91f1-4a39f5083a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:00.753366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 521/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:45:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:00.911791 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea09ad5-6ca4-445f-80f6-a7b72c291861 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:00.927650 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea09ad5-6ca4-445f-80f6-a7b72c291861 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:00.930208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c137ba7-6347-45f3-89d7-b4f5d26216bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:00.930879 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137ba7-6347-45f3-89d7-b4f5d26216bd service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:00.931184 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137ba7-6347-45f3-89d7-b4f5d26216bd service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:00.931473 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c137ba7-6347-45f3-89d7-b4f5d26216bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:00.939594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c137ba7-6347-45f3-89d7-b4f5d26216bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:00.941690 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c137ba7-6347-45f3-89d7-b4f5d26216bd service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:00.951278 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 521/1042] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:01.822096 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e268-65d2-4c6e-8746-23ca53c12888 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:01.822696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e268-65d2-4c6e-8746-23ca53c12888 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:01.822696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e268-65d2-4c6e-8746-23ca53c12888 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:01.824111 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 522/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:01.829048 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78bd7d-07b8-40ce-9042-468d44d18fdd None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:01.829445 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78bd7d-07b8-40ce-9042-468d44d18fdd None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:01.829624 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78bd7d-07b8-40ce-9042-468d44d18fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:01.849419 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-0d78bd7d-07b8-40ce-9042-468d44d18fdd None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:01.850646 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-0d78bd7d-07b8-40ce-9042-468d44d18fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:01.858330 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 522/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:45:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:02.014861 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e268-65d2-4c6e-8746-23ca53c12888 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:02.028752 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e268-65d2-4c6e-8746-23ca53c12888 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:02.033604 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d05df-8f38-4455-9f10-809b50bb752d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:02.035126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d05df-8f38-4455-9f10-809b50bb752d service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:02.035416 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d05df-8f38-4455-9f10-809b50bb752d service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:02.035699 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d05df-8f38-4455-9f10-809b50bb752d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:02.043730 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d05df-8f38-4455-9f10-809b50bb752d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:02.046317 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d05df-8f38-4455-9f10-809b50bb752d service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:02.054715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 523/1045] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:02.930931 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa779e-58b3-40e4-bbe0-b70dad9ba862 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:02.931444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa779e-58b3-40e4-bbe0-b70dad9ba862 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:02.931444 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa779e-58b3-40e4-bbe0-b70dad9ba862 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:02.932756 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 523/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:02.937569 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc1a5-1953-43bc-938e-041a256dadee None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:02.937947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc1a5-1953-43bc-938e-041a256dadee None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:02.938140 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc1a5-1953-43bc-938e-041a256dadee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:02.957919 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-c51dc1a5-1953-43bc-938e-041a256dadee None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:02.959140 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-c51dc1a5-1953-43bc-938e-041a256dadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:02.966780 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 524/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:45:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:03.122956 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa779e-58b3-40e4-bbe0-b70dad9ba862 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:03.137022 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa779e-58b3-40e4-bbe0-b70dad9ba862 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:03.142076 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74826067-5bf9-45af-8271-ef102b17c53c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:03.142726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826067-5bf9-45af-8271-ef102b17c53c service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:03.143053 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826067-5bf9-45af-8271-ef102b17c53c service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:03.143338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74826067-5bf9-45af-8271-ef102b17c53c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:03.152092 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74826067-5bf9-45af-8271-ef102b17c53c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:03.153705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74826067-5bf9-45af-8271-ef102b17c53c service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:03.163132 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 524/1048] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:04.100027 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2edcc5-743e-418c-84c8-b48e02e96b8c None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:04.100628 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2edcc5-743e-418c-84c8-b48e02e96b8c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:04.100734 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2edcc5-743e-418c-84c8-b48e02e96b8c None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:04.102078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 525/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:04.107154 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f771-7050-4216-bbf3-c590958f11b5 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:04.107867 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f771-7050-4216-bbf3-c590958f11b5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:04.107867 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f771-7050-4216-bbf3-c590958f11b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:04.128232 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-d314f771-7050-4216-bbf3-c590958f11b5 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:04.129585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-d314f771-7050-4216-bbf3-c590958f11b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:04.137656 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 525/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:45:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:04.326273 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2edcc5-743e-418c-84c8-b48e02e96b8c None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:04.343724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2edcc5-743e-418c-84c8-b48e02e96b8c None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:04.350220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cc2bb-822b-424f-93d1-01045df410e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:04.350853 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc2bb-822b-424f-93d1-01045df410e8 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:04.351146 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc2bb-822b-424f-93d1-01045df410e8 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:04.351545 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cc2bb-822b-424f-93d1-01045df410e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:04.360138 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cc2bb-822b-424f-93d1-01045df410e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:04.361748 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cc2bb-822b-424f-93d1-01045df410e8 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:04.375300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 526/1051] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:05.260698 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d2d46-0c35-416f-8ad4-d26609fdd788 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:05.261276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d2d46-0c35-416f-8ad4-d26609fdd788 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:05.261276 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d2d46-0c35-416f-8ad4-d26609fdd788 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:05.262614 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 526/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:05.267559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c4a0-32ef-4416-bc56-eba79a1ad582 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:05.267993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c4a0-32ef-4416-bc56-eba79a1ad582 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:05.268132 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c4a0-32ef-4416-bc56-eba79a1ad582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:05.287605 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-8060c4a0-32ef-4416-bc56-eba79a1ad582 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:05.288805 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-8060c4a0-32ef-4416-bc56-eba79a1ad582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:05.296595 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 527/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:45:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:05.455200 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d2d46-0c35-416f-8ad4-d26609fdd788 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:05.468384 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d2d46-0c35-416f-8ad4-d26609fdd788 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:05.473759 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e7f1-9e14-49a9-94a6-1fb65459083d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:05.474414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e7f1-9e14-49a9-94a6-1fb65459083d service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:05.474740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e7f1-9e14-49a9-94a6-1fb65459083d service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:05.475001 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e7f1-9e14-49a9-94a6-1fb65459083d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:05.482937 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e7f1-9e14-49a9-94a6-1fb65459083d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:05.484504 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e7f1-9e14-49a9-94a6-1fb65459083d service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:05.494263 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 527/1054] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:06.382531 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8e7e-67ec-4789-acc5-07367acace18 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:06.383095 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8e7e-67ec-4789-acc5-07367acace18 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:06.383095 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8e7e-67ec-4789-acc5-07367acace18 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:06.384451 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 528/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:06.389630 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d5bd-758c-4da3-825b-22576b245772 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:06.390099 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d5bd-758c-4da3-825b-22576b245772 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:06.390206 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d5bd-758c-4da3-825b-22576b245772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:06.409695 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-5911d5bd-758c-4da3-825b-22576b245772 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:06.410913 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-5911d5bd-758c-4da3-825b-22576b245772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:06.418598 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 528/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:45:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:06.573157 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff8e7e-67ec-4789-acc5-07367acace18 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:06.591299 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff8e7e-67ec-4789-acc5-07367acace18 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:06.592341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18655520-af15-471b-a8a4-39f0f01610f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:06.592989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655520-af15-471b-a8a4-39f0f01610f2 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:06.593278 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655520-af15-471b-a8a4-39f0f01610f2 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:06.593560 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655520-af15-471b-a8a4-39f0f01610f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:06.602586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18655520-af15-471b-a8a4-39f0f01610f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:06.608559 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18655520-af15-471b-a8a4-39f0f01610f2 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:06.615023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 529/1057] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:08.719052 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa12e-23d6-4ee7-8c3b-ce95fe242ca6 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:08.719586 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa12e-23d6-4ee7-8c3b-ce95fe242ca6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:08.719586 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa12e-23d6-4ee7-8c3b-ce95fe242ca6 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:08.720927 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 529/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:08.727046 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92abd5-6b56-4828-b409-dea55d5c7172 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:08.727480 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92abd5-6b56-4828-b409-dea55d5c7172 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:08.727589 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92abd5-6b56-4828-b409-dea55d5c7172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:08.746888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-9c92abd5-6b56-4828-b409-dea55d5c7172 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:08.748067 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-9c92abd5-6b56-4828-b409-dea55d5c7172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:08.755804 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 530/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:08.797491 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aa12e-23d6-4ee7-8c3b-ce95fe242ca6 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:08.808177 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aa12e-23d6-4ee7-8c3b-ce95fe242ca6 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:08.811671 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aaccf-924a-4432-94ee-0b70c5bf828b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:08.812308 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aaccf-924a-4432-94ee-0b70c5bf828b service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:08.812595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aaccf-924a-4432-94ee-0b70c5bf828b service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:08.812875 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aaccf-924a-4432-94ee-0b70c5bf828b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:08.822129 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aaccf-924a-4432-94ee-0b70c5bf828b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:08.823652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aaccf-924a-4432-94ee-0b70c5bf828b service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:08.833723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 530/1060] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:11.194783 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda79b-b201-470f-9fee-9637340bbaef None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:11.195357 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda79b-b201-470f-9fee-9637340bbaef None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:11.195357 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccda79b-b201-470f-9fee-9637340bbaef None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:11.196990 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 531/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:11.202312 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a1b6-81d1-49a5-bbfe-8264f2bdfdf8 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:11.202766 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a1b6-81d1-49a5-bbfe-8264f2bdfdf8 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:11.202931 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a1b6-81d1-49a5-bbfe-8264f2bdfdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:11.222593 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-f5f9a1b6-81d1-49a5-bbfe-8264f2bdfdf8 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:11.246536 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-f5f9a1b6-81d1-49a5-bbfe-8264f2bdfdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:11.246536 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 531/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:11.274519 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccda79b-b201-470f-9fee-9637340bbaef None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:11.285294 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccda79b-b201-470f-9fee-9637340bbaef None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:11.288826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094515e-5926-484f-8384-354ea66ce4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:11.289711 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094515e-5926-484f-8384-354ea66ce4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:11.289823 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094515e-5926-484f-8384-354ea66ce4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:11.290006 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094515e-5926-484f-8384-354ea66ce4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:11.301049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094515e-5926-484f-8384-354ea66ce4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:11.302535 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094515e-5926-484f-8384-354ea66ce4b6 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:11.313185 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 532/1063] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:45:14.350101 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c6f8-af77-4c8c-9128-cddcb1ebe7aa None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:14.350659 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c6f8-af77-4c8c-9128-cddcb1ebe7aa None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:14.350773 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c6f8-af77-4c8c-9128-cddcb1ebe7aa None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:14.352041 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:14.357498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10c15f-930e-41db-82fa-98c075923e83 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:14.357932 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10c15f-930e-41db-82fa-98c075923e83 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:14.358095 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10c15f-930e-41db-82fa-98c075923e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:14.380356 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-aa10c15f-930e-41db-82fa-98c075923e83 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:14.381639 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-aa10c15f-930e-41db-82fa-98c075923e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:14.392195 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:14.434673 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c6f8-af77-4c8c-9128-cddcb1ebe7aa None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:14.451053 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c6f8-af77-4c8c-9128-cddcb1ebe7aa None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:14.457715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7510e-9313-4a02-bca0-becbbfa2930f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:14.457715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7510e-9313-4a02-bca0-becbbfa2930f service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:14.457715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7510e-9313-4a02-bca0-becbbfa2930f service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:14.458231 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7510e-9313-4a02-bca0-becbbfa2930f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:14.469277 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7510e-9313-4a02-bca0-becbbfa2930f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:14.470743 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7510e-9313-4a02-bca0-becbbfa2930f service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:14.481678 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 533/1066] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:16.932663 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963de4d-e823-4099-a798-5f98f2e679a7 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:16.933195 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963de4d-e823-4099-a798-5f98f2e679a7 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:16.933195 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963de4d-e823-4099-a798-5f98f2e679a7 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:16.934563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:16.939739 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c15d-6abc-472c-b0ae-3f2c0c256e30 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:16.940738 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c15d-6abc-472c-b0ae-3f2c0c256e30 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:16.941019 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9c15d-6abc-472c-b0ae-3f2c0c256e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:16.961455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-ddd9c15d-6abc-472c-b0ae-3f2c0c256e30 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:16.962690 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-ddd9c15d-6abc-472c-b0ae-3f2c0c256e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:16.970576 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:17.012534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963de4d-e823-4099-a798-5f98f2e679a7 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:17.023645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963de4d-e823-4099-a798-5f98f2e679a7 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:17.027094 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583c70d-d8e8-40d4-a64c-48168947b51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:17.027723 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583c70d-d8e8-40d4-a64c-48168947b51a service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:17.028056 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583c70d-d8e8-40d4-a64c-48168947b51a service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:17.028335 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583c70d-d8e8-40d4-a64c-48168947b51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:17.037159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583c70d-d8e8-40d4-a64c-48168947b51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:17.038618 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583c70d-d8e8-40d4-a64c-48168947b51a service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:17.047904 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 535/1069] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:19.571597 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4378d9-debc-4fa5-9563-80d6ad4b3bbe None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:19.572138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4378d9-debc-4fa5-9563-80d6ad4b3bbe None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:19.572138 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4378d9-debc-4fa5-9563-80d6ad4b3bbe None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:19.573436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:19.578641 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b989d7-a246-43e6-bd55-1a4da171c6c3 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:19.579084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b989d7-a246-43e6-bd55-1a4da171c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:19.579190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b989d7-a246-43e6-bd55-1a4da171c6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:19.598966 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-92b989d7-a246-43e6-bd55-1a4da171c6c3 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:19.600151 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-92b989d7-a246-43e6-bd55-1a4da171c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:19.608301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:45:19.647723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4378d9-debc-4fa5-9563-80d6ad4b3bbe None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:19.658072 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4378d9-debc-4fa5-9563-80d6ad4b3bbe None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:19.661533 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabd957-9e35-43de-a783-2fcb08cd3cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:19.662164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabd957-9e35-43de-a783-2fcb08cd3cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:19.662443 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabd957-9e35-43de-a783-2fcb08cd3cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:19.662747 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabd957-9e35-43de-a783-2fcb08cd3cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:19.671373 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabd957-9e35-43de-a783-2fcb08cd3cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:19.672784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabd957-9e35-43de-a783-2fcb08cd3cb8 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:19.682531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 536/1072] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:21.976460 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2128-5077-471d-b9cd-7d13a5566be6 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:21.976995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2128-5077-471d-b9cd-7d13a5566be6 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:21.976995 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2128-5077-471d-b9cd-7d13a5566be6 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:21.978300 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:21.983526 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26d02-d1eb-4254-a712-d03a650487fd None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:21.983915 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26d02-d1eb-4254-a712-d03a650487fd None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:21.984091 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26d02-d1eb-4254-a712-d03a650487fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:21.991574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=70 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:45:22.004025 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-96d26d02-d1eb-4254-a712-d03a650487fd None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:22.005217 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-96d26d02-d1eb-4254-a712-d03a650487fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:22.013024 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:22.052392 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef2128-5077-471d-b9cd-7d13a5566be6 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:22.057793 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=64 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:45:22.063435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef2128-5077-471d-b9cd-7d13a5566be6 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:22.067739 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c9bd1-62f2-4d51-90d4-94a0b3dd1799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:22.068384 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9bd1-62f2-4d51-90d4-94a0b3dd1799 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:22.071583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9bd1-62f2-4d51-90d4-94a0b3dd1799 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:22.071583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9bd1-62f2-4d51-90d4-94a0b3dd1799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:22.078367 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c9bd1-62f2-4d51-90d4-94a0b3dd1799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:22.079932 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c9bd1-62f2-4d51-90d4-94a0b3dd1799 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:22.090033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 538/1075] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:24.357912 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461c394-44cf-40b3-a664-281cdea8a6ea None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:24.358404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461c394-44cf-40b3-a664-281cdea8a6ea None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:24.358537 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461c394-44cf-40b3-a664-281cdea8a6ea None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:24.359868 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:24.365159 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008549f-1fb4-430b-ad22-b793d46384be None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:24.365610 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008549f-1fb4-430b-ad22-b793d46384be None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:24.365716 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008549f-1fb4-430b-ad22-b793d46384be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:24.385355 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-1008549f-1fb4-430b-ad22-b793d46384be None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:24.386684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-1008549f-1fb4-430b-ad22-b793d46384be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:24.395162 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:24.432943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461c394-44cf-40b3-a664-281cdea8a6ea None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:24.444270 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461c394-44cf-40b3-a664-281cdea8a6ea None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:24.448014 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e2fb0-1db1-4f41-aaf2-3a496530f8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:24.448650 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2fb0-1db1-4f41-aaf2-3a496530f8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:24.448942 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2fb0-1db1-4f41-aaf2-3a496530f8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:24.449221 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2fb0-1db1-4f41-aaf2-3a496530f8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:24.458827 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e2fb0-1db1-4f41-aaf2-3a496530f8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:24.460266 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e2fb0-1db1-4f41-aaf2-3a496530f8e5 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:24.469612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 539/1078] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:26.734563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e9b6-2921-4342-b405-46d9e2bf4403 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:26.735083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e9b6-2921-4342-b405-46d9e2bf4403 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:26.735083 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2e9b6-2921-4342-b405-46d9e2bf4403 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:26.737286 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:26.742629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e759-1243-4795-835c-f1175654b815 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:26.743120 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e759-1243-4795-835c-f1175654b815 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:26.743237 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e759-1243-4795-835c-f1175654b815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:26.762907 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-2033e759-1243-4795-835c-f1175654b815 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:26.764097 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-2033e759-1243-4795-835c-f1175654b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:26.772371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:26.811289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2e9b6-2921-4342-b405-46d9e2bf4403 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:26.822224 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2e9b6-2921-4342-b405-46d9e2bf4403 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:26.825726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c55b-ba81-4f7a-a61c-0e4a4bb0cabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:26.826391 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c55b-ba81-4f7a-a61c-0e4a4bb0cabd service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:26.826707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c55b-ba81-4f7a-a61c-0e4a4bb0cabd service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:26.826987 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c55b-ba81-4f7a-a61c-0e4a4bb0cabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:26.836379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c55b-ba81-4f7a-a61c-0e4a4bb0cabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:26.837820 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c55b-ba81-4f7a-a61c-0e4a4bb0cabd service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:26.847809 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 541/1081] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:29.072740 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879d57-4f59-48e7-9c97-7e4169ebae2e None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:29.073301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879d57-4f59-48e7-9c97-7e4169ebae2e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:29.073301 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b879d57-4f59-48e7-9c97-7e4169ebae2e None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:29.074763 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:29.080048 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5baddc-4ff1-435d-894a-d7cc5366e5ae None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:29.080616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5baddc-4ff1-435d-894a-d7cc5366e5ae None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:29.080748 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5baddc-4ff1-435d-894a-d7cc5366e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:29.099704 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-6b5baddc-4ff1-435d-894a-d7cc5366e5ae None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:29.100897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-6b5baddc-4ff1-435d-894a-d7cc5366e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:29.108817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:29.147459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879d57-4f59-48e7-9c97-7e4169ebae2e None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:29.157873 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b879d57-4f59-48e7-9c97-7e4169ebae2e None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:29.161550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744809c-5d7f-426b-b0f6-27bedf807788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:29.162183 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744809c-5d7f-426b-b0f6-27bedf807788 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:29.162477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744809c-5d7f-426b-b0f6-27bedf807788 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:29.162771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744809c-5d7f-426b-b0f6-27bedf807788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:29.171770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744809c-5d7f-426b-b0f6-27bedf807788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:29.173186 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744809c-5d7f-426b-b0f6-27bedf807788 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:29.182940 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 542/1084] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:31.439029 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6782a-21e8-4f71-a2b6-543f4fafee44 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:31.439718 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6782a-21e8-4f71-a2b6-543f4fafee44 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:31.439718 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6782a-21e8-4f71-a2b6-543f4fafee44 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:31.441034 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:31.446703 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ea23-57f6-4911-9a2c-fd07e32efee1 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:31.447158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ea23-57f6-4911-9a2c-fd07e32efee1 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:31.447260 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ea23-57f6-4911-9a2c-fd07e32efee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:31.466861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-4785ea23-57f6-4911-9a2c-fd07e32efee1 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:31.468070 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-4785ea23-57f6-4911-9a2c-fd07e32efee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:31.476431 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:45:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:31.513269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6782a-21e8-4f71-a2b6-543f4fafee44 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:31.524368 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6782a-21e8-4f71-a2b6-543f4fafee44 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:31.527857 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7093cdd-2c1c-492d-8f81-a3591db636d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:31.528495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093cdd-2c1c-492d-8f81-a3591db636d6 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:31.528782 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093cdd-2c1c-492d-8f81-a3591db636d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:31.529061 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093cdd-2c1c-492d-8f81-a3591db636d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:31.538480 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7093cdd-2c1c-492d-8f81-a3591db636d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:31.539925 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7093cdd-2c1c-492d-8f81-a3591db636d6 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:31.549485 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 544/1087] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:41.461706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=20 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:45:41.545098 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=23 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:45:55.207104 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62183d-fd0d-447f-a9bf-0e6abef8b6b6 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:55.207646 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62183d-fd0d-447f-a9bf-0e6abef8b6b6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:55.207646 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62183d-fd0d-447f-a9bf-0e6abef8b6b6 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:55.209021 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 544/1088] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:55.214235 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ef09-e6b0-420f-b43a-bd6558a8716d None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:55.214662 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ef09-e6b0-420f-b43a-bd6558a8716d None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:55.214835 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ef09-e6b0-420f-b43a-bd6558a8716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:55.233687 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-a4c6ef09-e6b0-420f-b43a-bd6558a8716d None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:55.234921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-a4c6ef09-e6b0-420f-b43a-bd6558a8716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:55.243412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 545/1089] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:45:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:55.293334 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ffe1d-4968-4430-bdfa-6724fee59cba None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:55.293629 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ffe1d-4968-4430-bdfa-6724fee59cba None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:55.293908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ffe1d-4968-4430-bdfa-6724fee59cba None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:55.295295 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 545/1090] 10.222.0.67 () {54 vars in 966 bytes} [Mon Jul 25 09:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:55.301185 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c417bb9-f4d6-4732-ba06-9191ea43fe75 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:55.301479 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c417bb9-f4d6-4732-ba06-9191ea43fe75 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:55.301763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c417bb9-f4d6-4732-ba06-9191ea43fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:55.321870 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-7c417bb9-f4d6-4732-ba06-9191ea43fe75 None None] MFA Rules not processed for user `1a17097c198d491198553e03fd8e8327`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:55.323092 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-7c417bb9-f4d6-4732-ba06-9191ea43fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:55.329502 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 546/1091] 10.222.0.67 () {58 vars in 1063 bytes} [Mon Jul 25 09:45:55 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:55.336785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ffe1d-4968-4430-bdfa-6724fee59cba None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:55.347455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ffe1d-4968-4430-bdfa-6724fee59cba None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:55.350941 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d463f0d-09c3-47a8-8347-7f81ba9680ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17097c198d491198553e03fd8e8327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:55.351577 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463f0d-09c3-47a8-8347-7f81ba9680ab service glance] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:55.351862 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463f0d-09c3-47a8-8347-7f81ba9680ab service glance] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:55.352140 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463f0d-09c3-47a8-8347-7f81ba9680ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:55.361608 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d463f0d-09c3-47a8-8347-7f81ba9680ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:55.363082 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d463f0d-09c3-47a8-8347-7f81ba9680ab service glance] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:55.372402 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 546/1092] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:45:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:45:57.694707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487823-e9e4-4869-9ed4-ac14033013eb None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:57.694707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487823-e9e4-4869-9ed4-ac14033013eb None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:57.695393 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93487823-e9e4-4869-9ed4-ac14033013eb None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:57.696487 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 547/1093] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:45:57.701671 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13594a9-a76b-4cea-bf5e-976ec01e1bb7 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:57.702055 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13594a9-a76b-4cea-bf5e-976ec01e1bb7 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:57.702234 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13594a9-a76b-4cea-bf5e-976ec01e1bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:57.722590 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-c13594a9-a76b-4cea-bf5e-976ec01e1bb7 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:45:57.723796 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-c13594a9-a76b-4cea-bf5e-976ec01e1bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:45:57.731721 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 547/1094] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:45:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:45:57.755698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93487823-e9e4-4869-9ed4-ac14033013eb None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:45:57.768766 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93487823-e9e4-4869-9ed4-ac14033013eb None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:45:57.773253 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81c0a-f6e5-4597-8642-e60cb41d2bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:45:57.773894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81c0a-f6e5-4597-8642-e60cb41d2bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:45:57.774180 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81c0a-f6e5-4597-8642-e60cb41d2bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:45:57.774486 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81c0a-f6e5-4597-8642-e60cb41d2bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:45:57.775223 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a81c0a-f6e5-4597-8642-e60cb41d2bd5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:45:57.777041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING py.warnings [None req-28a81c0a-f6e5-4597-8642-e60cb41d2bd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:45:57.777041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: warnings.warn(msg) Jul 25 09:45:57.777041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: Jul 25 09:45:57.778189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a81c0a-f6e5-4597-8642-e60cb41d2bd5 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:45:57.796849 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 548/1095] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Jul 25 09:45:57 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:46:00.056405 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa40b2-675b-433e-b9a3-0e84076983ef None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:00.057035 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa40b2-675b-433e-b9a3-0e84076983ef None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:00.057035 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa40b2-675b-433e-b9a3-0e84076983ef None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:00.058367 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 548/1096] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:46:00.063715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fde7d-1d49-4118-acd8-25f33c9bd36a None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:00.064145 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fde7d-1d49-4118-acd8-25f33c9bd36a None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:00.064292 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fde7d-1d49-4118-acd8-25f33c9bd36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:00.084186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-6b5fde7d-1d49-4118-acd8-25f33c9bd36a None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:46:00.085418 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-6b5fde7d-1d49-4118-acd8-25f33c9bd36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:46:00.093269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 549/1097] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:46:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:46:00.137352 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa40b2-675b-433e-b9a3-0e84076983ef None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:46:00.151425 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa40b2-675b-433e-b9a3-0e84076983ef None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:46:00.156340 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a926cf8-a952-4c0a-a72e-31333e2c76b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:46:00.156977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926cf8-a952-4c0a-a72e-31333e2c76b9 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:00.157283 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926cf8-a952-4c0a-a72e-31333e2c76b9 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:00.157564 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926cf8-a952-4c0a-a72e-31333e2c76b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:00.165710 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a926cf8-a952-4c0a-a72e-31333e2c76b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:46:00.167328 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a926cf8-a952-4c0a-a72e-31333e2c76b9 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:46:00.176946 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 549/1098] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:46:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:46:02.546874 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfac5c-b2bc-4749-971b-3ace6a4b8dde None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:02.547430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfac5c-b2bc-4749-971b-3ace6a4b8dde None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:02.547430 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfac5c-b2bc-4749-971b-3ace6a4b8dde None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:02.549374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 550/1099] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:46:02.554578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d30d-8748-4647-9c1f-59c031e90532 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:02.554997 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d30d-8748-4647-9c1f-59c031e90532 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:02.556843 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d30d-8748-4647-9c1f-59c031e90532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:02.574244 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-d723d30d-8748-4647-9c1f-59c031e90532 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:46:02.575458 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-d723d30d-8748-4647-9c1f-59c031e90532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:46:02.584170 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 550/1100] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:46:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:46:02.623246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfac5c-b2bc-4749-971b-3ace6a4b8dde None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:46:02.634135 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfac5c-b2bc-4749-971b-3ace6a4b8dde None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:46:02.637724 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c5ef2-5753-4e3b-a285-07ab79aa7481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:46:02.638353 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c5ef2-5753-4e3b-a285-07ab79aa7481 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:02.638687 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c5ef2-5753-4e3b-a285-07ab79aa7481 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:02.639004 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c5ef2-5753-4e3b-a285-07ab79aa7481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:02.651817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c5ef2-5753-4e3b-a285-07ab79aa7481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:46:02.653275 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c5ef2-5753-4e3b-a285-07ab79aa7481 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:46:02.663583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 551/1101] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:46:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:46:04.893492 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98630-757c-4b3f-a436-2ca1c3a47ecd None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:04.894055 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98630-757c-4b3f-a436-2ca1c3a47ecd None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:04.894055 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98630-757c-4b3f-a436-2ca1c3a47ecd None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:04.895436 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 551/1102] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:46:04.900716 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4818-0978-4c0c-8c71-4944c49bda45 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:04.901158 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4818-0978-4c0c-8c71-4944c49bda45 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:04.901283 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4818-0978-4c0c-8c71-4944c49bda45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:04.920437 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-46cf4818-0978-4c0c-8c71-4944c49bda45 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:46:04.921621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-46cf4818-0978-4c0c-8c71-4944c49bda45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:46:04.929537 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 552/1103] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:46:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:46:04.969245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98630-757c-4b3f-a436-2ca1c3a47ecd None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:46:04.980034 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98630-757c-4b3f-a436-2ca1c3a47ecd None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:46:04.983574 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe29c67-03ec-41cd-8be7-47a50f3f71c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:46:04.984209 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe29c67-03ec-41cd-8be7-47a50f3f71c0 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:04.984494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe29c67-03ec-41cd-8be7-47a50f3f71c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:04.984770 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe29c67-03ec-41cd-8be7-47a50f3f71c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:04.994080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe29c67-03ec-41cd-8be7-47a50f3f71c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:46:04.995686 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe29c67-03ec-41cd-8be7-47a50f3f71c0 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:46:05.005585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 552/1104] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:46:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:46:07.456660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b398cd-4b81-46c0-aad8-dfc431e7f9b4 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:07.457191 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b398cd-4b81-46c0-aad8-dfc431e7f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:07.457309 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b398cd-4b81-46c0-aad8-dfc431e7f9b4 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:07.458634 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 553/1105] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:46:07.463943 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043e8c-58cf-4d37-a8be-2f49a91b8c61 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:07.464355 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043e8c-58cf-4d37-a8be-2f49a91b8c61 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:07.464507 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043e8c-58cf-4d37-a8be-2f49a91b8c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:07.483417 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-01043e8c-58cf-4d37-a8be-2f49a91b8c61 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:46:07.484604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-01043e8c-58cf-4d37-a8be-2f49a91b8c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:46:07.493079 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 553/1106] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:46:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:46:07.533879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b398cd-4b81-46c0-aad8-dfc431e7f9b4 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:46:07.544434 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b398cd-4b81-46c0-aad8-dfc431e7f9b4 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:46:07.548611 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5da43-73c1-4db2-a99a-55b0d75caa05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:46:07.549248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5da43-73c1-4db2-a99a-55b0d75caa05 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:07.549534 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5da43-73c1-4db2-a99a-55b0d75caa05 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:07.549817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5da43-73c1-4db2-a99a-55b0d75caa05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:07.558676 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5da43-73c1-4db2-a99a-55b0d75caa05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:46:07.560120 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5da43-73c1-4db2-a99a-55b0d75caa05 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:46:07.570282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 554/1107] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:46:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:46:10.098213 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c692bf7-4bd4-465f-89ed-989ceafe577a None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:10.098851 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c692bf7-4bd4-465f-89ed-989ceafe577a None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:10.098851 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c692bf7-4bd4-465f-89ed-989ceafe577a None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:10.100167 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 554/1108] 10.222.0.67 () {54 vars in 926 bytes} [Mon Jul 25 09:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:46:10.105249 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0aa79-ccd3-4114-96e5-244b15af3673 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:10.105693 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0aa79-ccd3-4114-96e5-244b15af3673 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:10.105796 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0aa79-ccd3-4114-96e5-244b15af3673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:10.124542 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-20e0aa79-ccd3-4114-96e5-244b15af3673 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:46:10.126286 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-20e0aa79-ccd3-4114-96e5-244b15af3673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:46:10.134121 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 555/1109] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Jul 25 09:46:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:46:10.173551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c692bf7-4bd4-465f-89ed-989ceafe577a None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:46:10.184093 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c692bf7-4bd4-465f-89ed-989ceafe577a None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:46:10.192842 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5ab0-457b-44e5-8f1f-2cbb7b332e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:46:10.192842 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5ab0-457b-44e5-8f1f-2cbb7b332e2e service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:46:10.192842 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5ab0-457b-44e5-8f1f-2cbb7b332e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:46:10.192842 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5ab0-457b-44e5-8f1f-2cbb7b332e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:46:10.198380 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5ab0-457b-44e5-8f1f-2cbb7b332e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:46:10.199844 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5ab0-457b-44e5-8f1f-2cbb7b332e2e service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:46:10.209692 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 555/1110] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:46:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:46:20.119832 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=33 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:46:20.205573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=33 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:47:48.478542 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c23481-4545-47b1-b398-cf2fe40802c6 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:48.479170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c23481-4545-47b1-b398-cf2fe40802c6 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:48.479170 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c23481-4545-47b1-b398-cf2fe40802c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:48.499458 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-15c23481-4545-47b1-b398-cf2fe40802c6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:47:48.500676 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-15c23481-4545-47b1-b398-cf2fe40802c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:47:48.508541 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 556/1111] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:47:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:47:48.516561 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089319f-74dc-43b8-8edf-6146271ca2ee None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:48.517109 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089319f-74dc-43b8-8edf-6146271ca2ee None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:48.517109 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089319f-74dc-43b8-8edf-6146271ca2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:48.535865 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-8089319f-74dc-43b8-8edf-6146271ca2ee None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:47:48.537058 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-8089319f-74dc-43b8-8edf-6146271ca2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:47:48.545377 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 556/1112] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:47:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:47:48.549787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c23481-4545-47b1-b398-cf2fe40802c6 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:48.560842 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c23481-4545-47b1-b398-cf2fe40802c6 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:48.565496 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:48.566167 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:48.566454 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:48.566882 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:48.567497 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:47:48.567808 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:48.569105 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING py.warnings [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:47:48.569105 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: warnings.warn(msg) Jul 25 09:47:48.569105 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: Jul 25 09:47:48.569998 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:48.583080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 557/1113] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Jul 25 09:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:47:48.591250 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089319f-74dc-43b8-8edf-6146271ca2ee None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:48.603035 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089319f-74dc-43b8-8edf-6146271ca2ee None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:48.608003 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:48.608697 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:48.608985 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:48.609263 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:48.609969 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:48.611878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WARNING py.warnings [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:47:48.611878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: warnings.warn(msg) Jul 25 09:47:48.611878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: Jul 25 09:47:48.613100 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:48.806290 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 557/1114] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Jul 25 09:47:48 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:47:48.811740 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:48.822108 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7a39a-f1e4-4066-b865-5f58ee8cd6ce admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:48.878129 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:48.878759 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:48.879049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:48.879331 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:48.880028 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:48.881045 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING py.warnings [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:47:48.881045 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: warnings.warn(msg) Jul 25 09:47:48.881045 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: Jul 25 09:47:48.882256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:48.988081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 558/1115] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:47:48 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:47:48.992495 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:49.003017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191c4c-0e5b-45dc-a04f-1f9b752beb8a admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:49.007559 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:49.008216 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.008504 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.008789 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.009540 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:49.010591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WARNING py.warnings [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:47:49.010591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: warnings.warn(msg) Jul 25 09:47:49.010591 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: Jul 25 09:47:49.011483 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:49.024385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 558/1116] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:47:49.029513 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:49.039529 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a581e9-7193-4403-be99-ba511ec6de32 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:49.043952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca467e4a-9442-42c2-9cfb-7bfd9fce090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:49.045239 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467e4a-9442-42c2-9cfb-7bfd9fce090a admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.045524 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467e4a-9442-42c2-9cfb-7bfd9fce090a admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.045817 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467e4a-9442-42c2-9cfb-7bfd9fce090a admin admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.046555 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467e4a-9442-42c2-9cfb-7bfd9fce090a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:49.047596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING py.warnings [None req-ca467e4a-9442-42c2-9cfb-7bfd9fce090a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:47:49.047596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: warnings.warn(msg) Jul 25 09:47:49.047596 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: Jul 25 09:47:49.048470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca467e4a-9442-42c2-9cfb-7bfd9fce090a admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:49.063025 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 559/1117] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:47:49.067066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:49.077081 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9e654-86c7-4686-9038-1c950fcbf958 admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:49.081633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f88e1-92fc-4c14-8357-c1bc92047ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:49.082521 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f88e1-92fc-4c14-8357-c1bc92047ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.082806 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f88e1-92fc-4c14-8357-c1bc92047ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.083082 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f88e1-92fc-4c14-8357-c1bc92047ff1 admin admin] PATH_INFO: `/v3/projects/c459a5bf1b754114bd800e9a265ff360/users/0717d01fe7d944c880ecdc7d60cfdd25/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.098372 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f88e1-92fc-4c14-8357-c1bc92047ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c459a5bf1b754114bd800e9a265ff360, user_id=0717d01fe7d944c880ecdc7d60cfdd25, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:49.099430 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WARNING py.warnings [None req-023f88e1-92fc-4c14-8357-c1bc92047ff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:47:49.099430 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: warnings.warn(msg) Jul 25 09:47:49.099430 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: Jul 25 09:47:49.101534 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f88e1-92fc-4c14-8357-c1bc92047ff1 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:49.205705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 559/1118] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Jul 25 09:47:49 2022] PUT /identity/v3/projects/c459a5bf1b754114bd800e9a265ff360/users/0717d01fe7d944c880ecdc7d60cfdd25/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:47:49.217917 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0131-95e9-4f3c-afc2-51217a8740e2 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.218212 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0131-95e9-4f3c-afc2-51217a8740e2 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.218525 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a0131-95e9-4f3c-afc2-51217a8740e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.246675 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-974a0131-95e9-4f3c-afc2-51217a8740e2 None None] MFA Rules not processed for user `0717d01fe7d944c880ecdc7d60cfdd25`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:47:49.248684 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-974a0131-95e9-4f3c-afc2-51217a8740e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:47:49.312039 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 560/1119] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:47:49 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:47:49.332850 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411fe01-0c5c-4521-8160-0d3661c12e6e None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.333154 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411fe01-0c5c-4521-8160-0d3661c12e6e None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.333462 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411fe01-0c5c-4521-8160-0d3661c12e6e None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.334891 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 560/1120] 10.222.0.67 () {54 vars in 964 bytes} [Mon Jul 25 09:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:47:49.339857 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578c4c-8b6f-4fd8-9e9a-1cfe93c5c4cc None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.340156 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578c4c-8b6f-4fd8-9e9a-1cfe93c5c4cc None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.340444 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578c4c-8b6f-4fd8-9e9a-1cfe93c5c4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.360524 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-68578c4c-8b6f-4fd8-9e9a-1cfe93c5c4cc None None] MFA Rules not processed for user `362c7977a3564cc1a9c0ff0f0dcc6df6`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:47:49.361744 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-68578c4c-8b6f-4fd8-9e9a-1cfe93c5c4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:47:49.405086 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:47:49.412386 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 561/1121] 10.222.0.67 () {58 vars in 1061 bytes} [Mon Jul 25 09:47:49 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:47:49.420657 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411fe01-0c5c-4521-8160-0d3661c12e6e None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:49.431056 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411fe01-0c5c-4521-8160-0d3661c12e6e None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:49.434513 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e714-6455-4fb4-9f92-ce9e67476d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c7977a3564cc1a9c0ff0f0dcc6df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:49.435306 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e714-6455-4fb4-9f92-ce9e67476d42 service cinder] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.435592 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e714-6455-4fb4-9f92-ce9e67476d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.435867 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e714-6455-4fb4-9f92-ce9e67476d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.444615 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956e714-6455-4fb4-9f92-ce9e67476d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:49.445995 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956e714-6455-4fb4-9f92-ce9e67476d42 service cinder] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:49.455338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 561/1122] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:47:49 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:47:49.493259 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271863de-0143-408b-a9c6-33aad20983de None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.493689 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271863de-0143-408b-a9c6-33aad20983de None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.493883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271863de-0143-408b-a9c6-33aad20983de None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.495119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 562/1123] 10.222.0.67 () {52 vars in 830 bytes} [Mon Jul 25 09:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:47:49.499275 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e714-6455-4fb4-9f92-ce9e67476d42 service cinder] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:49.560604 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e714-6455-4fb4-9f92-ce9e67476d42 service cinder] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:49.565151 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:49.566011 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:49.566299 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:49.566612 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] PATH_INFO: `/v3/users/0717d01fe7d944c880ecdc7d60cfdd25` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:49.567826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0717d01fe7d944c880ecdc7d60cfdd25)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:49.569099 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WARNING py.warnings [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:47:49.569099 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: warnings.warn(msg) Jul 25 09:47:49.569099 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: Jul 25 09:47:49.570318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:49.857319 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0717d01fe7d944c880ecdc7d60cfdd25'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:49.858082 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0717d01fe7d944c880ecdc7d60cfdd25'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:49.858775 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0717d01fe7d944c880ecdc7d60cfdd25'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:49.870886 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0717d01fe7d944c880ecdc7d60cfdd25'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:50.154806 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0717d01fe7d944c880ecdc7d60cfdd25'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:50.172313 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:47:50.179969 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 562/1124] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Jul 25 09:47:49 2022] DELETE /identity/v3/users/0717d01fe7d944c880ecdc7d60cfdd25 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:47:50.184622 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6c78-a1aa-4a91-b780-50368c81e503 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:50.184933 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6c78-a1aa-4a91-b780-50368c81e503 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:50.185218 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6c78-a1aa-4a91-b780-50368c81e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:50.205189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-629f6c78-a1aa-4a91-b780-50368c81e503 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:47:50.206384 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-629f6c78-a1aa-4a91-b780-50368c81e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:47:50.264992 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 563/1125] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:47:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:47:50.275238 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:50.276719 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:47:50.334778 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77605392-2df7-450e-8be8-2fed699fdb59 admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:50.338986 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a765-def1-4da3-a882-aa6f8196e58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:50.339643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a765-def1-4da3-a882-aa6f8196e58b service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:50.339930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a765-def1-4da3-a882-aa6f8196e58b service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:50.340230 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a765-def1-4da3-a882-aa6f8196e58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:50.350370 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a765-def1-4da3-a882-aa6f8196e58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:50.351838 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a765-def1-4da3-a882-aa6f8196e58b service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:50.361228 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 563/1126] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:47:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:47:50.903923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6c78-a1aa-4a91-b780-50368c81e503 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:47:50.907157 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-629f6c78-a1aa-4a91-b780-50368c81e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:47:50.924891 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6c78-a1aa-4a91-b780-50368c81e503 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:47:50.925749 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:47:50.926640 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:47:50.926932 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:47:50.927214 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] PATH_INFO: `/v3/projects/c459a5bf1b754114bd800e9a265ff360` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:47:50.928431 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c459a5bf1b754114bd800e9a265ff360)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:47:50.929503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING py.warnings [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:47:50.929503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: warnings.warn(msg) Jul 25 09:47:50.929503 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: Jul 25 09:47:50.930733 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:47:51.073214 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c459a5bf1b754114bd800e9a265ff360', 'request_id': 'req-a3626e95-1e11-4133-b512-533becf9a37c'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:51.087104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c459a5bf1b754114bd800e9a265ff360', 'request_id': 'req-a3626e95-1e11-4133-b512-533becf9a37c'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:51.093860 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c459a5bf1b754114bd800e9a265ff360', 'request_id': 'req-a3626e95-1e11-4133-b512-533becf9a37c'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:51.176281 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] The token cache is being invalidate because project c459a5bf1b754114bd800e9a265ff360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93888) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:47:51.176498 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:51.177129 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-a3626e95-1e11-4133-b512-533becf9a37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:47:51.178826 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 564/1127] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Jul 25 09:47:50 2022] DELETE /identity/v3/projects/c459a5bf1b754114bd800e9a265ff360 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:48:00.357024 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:48:01.173081 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:49:11.097337 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54641760-9837-4979-9c0b-3b439d1c4edf None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:11.097937 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54641760-9837-4979-9c0b-3b439d1c4edf None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:11.097937 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54641760-9837-4979-9c0b-3b439d1c4edf None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:11.099321 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:11.104022 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8121479-3cde-4061-a613-f811f4370ef9 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:11.104446 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8121479-3cde-4061-a613-f811f4370ef9 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:11.104585 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8121479-3cde-4061-a613-f811f4370ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:11.124984 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-c8121479-3cde-4061-a613-f811f4370ef9 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:11.126179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-c8121479-3cde-4061-a613-f811f4370ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:11.184333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:49:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:11.344514 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54641760-9837-4979-9c0b-3b439d1c4edf None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:11.346254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-54641760-9837-4979-9c0b-3b439d1c4edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:11.416316 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54641760-9837-4979-9c0b-3b439d1c4edf None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:11.421985 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4b80a-2f81-493d-b5c8-019fa6e076f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:11.422666 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b80a-2f81-493d-b5c8-019fa6e076f6 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:11.422956 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b80a-2f81-493d-b5c8-019fa6e076f6 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:11.423236 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b80a-2f81-493d-b5c8-019fa6e076f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:11.431596 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4b80a-2f81-493d-b5c8-019fa6e076f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:11.433184 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4b80a-2f81-493d-b5c8-019fa6e076f6 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:11.442953 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 565/1130] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:12.285162 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741d97-5064-4505-b285-647403aac844 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:12.285711 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741d97-5064-4505-b285-647403aac844 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:12.285711 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741d97-5064-4505-b285-647403aac844 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:12.287171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:12.292201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8dcd6-2e03-4ea2-9639-1f685a1d256d None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:12.292632 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8dcd6-2e03-4ea2-9639-1f685a1d256d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:12.292799 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8dcd6-2e03-4ea2-9639-1f685a1d256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:12.313605 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-f6f8dcd6-2e03-4ea2-9639-1f685a1d256d None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:12.314854 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-f6f8dcd6-2e03-4ea2-9639-1f685a1d256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:12.322855 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:49:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:12.484044 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed741d97-5064-4505-b285-647403aac844 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:12.497435 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed741d97-5064-4505-b285-647403aac844 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:12.503192 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3435-c49d-4d1b-a1fb-b774d734a8a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:12.503830 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3435-c49d-4d1b-a1fb-b774d734a8a0 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:12.504123 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3435-c49d-4d1b-a1fb-b774d734a8a0 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:12.504408 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3435-c49d-4d1b-a1fb-b774d734a8a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:12.512621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3435-c49d-4d1b-a1fb-b774d734a8a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:12.514236 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3435-c49d-4d1b-a1fb-b774d734a8a0 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:12.523671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 567/1133] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:17.001585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8a89-8460-44bd-825e-34e345f9afcc None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:17.002150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8a89-8460-44bd-825e-34e345f9afcc None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:17.002150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8a89-8460-44bd-825e-34e345f9afcc None None] PATH_INFO: `/v3` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:17.003464 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 567/1134] 10.222.0.45 () {54 vars in 925 bytes} [Mon Jul 25 09:49:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 09:49:17.009470 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cddeea-1aa3-4fd1-983c-c402bd61e679 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:17.009899 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cddeea-1aa3-4fd1-983c-c402bd61e679 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:17.010041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cddeea-1aa3-4fd1-983c-c402bd61e679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:17.043717 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-62cddeea-1aa3-4fd1-983c-c402bd61e679 None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:17.044915 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-62cddeea-1aa3-4fd1-983c-c402bd61e679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:17.107512 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 568/1135] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Jul 25 09:49:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:22.306799 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=35 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:49:23.747801 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b822-311a-44d2-af74-398a77b349b9 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:23.748494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b822-311a-44d2-af74-398a77b349b9 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:23.748494 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b822-311a-44d2-af74-398a77b349b9 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:23.749679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 568/1136] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:23.755122 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e6393-c058-494f-8cc1-7d029e4cc7e0 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:23.755570 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e6393-c058-494f-8cc1-7d029e4cc7e0 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:23.755825 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e6393-c058-494f-8cc1-7d029e4cc7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:23.775683 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-099e6393-c058-494f-8cc1-7d029e4cc7e0 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:23.776883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-099e6393-c058-494f-8cc1-7d029e4cc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:23.785286 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 569/1137] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:49:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:23.948657 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3b822-311a-44d2-af74-398a77b349b9 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:23.963058 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3b822-311a-44d2-af74-398a77b349b9 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:23.968083 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b0123-fb34-40cd-b3ed-b753cd47f5bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:23.968787 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0123-fb34-40cd-b3ed-b753cd47f5bd service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:23.969158 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0123-fb34-40cd-b3ed-b753cd47f5bd service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:23.969567 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0123-fb34-40cd-b3ed-b753cd47f5bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:23.979329 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b0123-fb34-40cd-b3ed-b753cd47f5bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:23.980995 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b0123-fb34-40cd-b3ed-b753cd47f5bd service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:23.990849 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 569/1138] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:24.833645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998a14d-5260-442a-a470-bd8bf4ab1470 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:24.834231 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998a14d-5260-442a-a470-bd8bf4ab1470 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:24.834360 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998a14d-5260-442a-a470-bd8bf4ab1470 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:24.835862 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:24.840843 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990036b-762f-49a5-b334-9c9e84c42e7d None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:24.841251 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990036b-762f-49a5-b334-9c9e84c42e7d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:24.841414 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990036b-762f-49a5-b334-9c9e84c42e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:24.861595 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-1990036b-762f-49a5-b334-9c9e84c42e7d None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:24.862851 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-1990036b-762f-49a5-b334-9c9e84c42e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:24.871064 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:49:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:25.032309 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998a14d-5260-442a-a470-bd8bf4ab1470 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:25.045776 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998a14d-5260-442a-a470-bd8bf4ab1470 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:25.051440 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c3d97-7f8a-4e23-91c1-99f8e85210e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:25.052078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c3d97-7f8a-4e23-91c1-99f8e85210e3 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:25.052366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c3d97-7f8a-4e23-91c1-99f8e85210e3 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:25.052647 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c3d97-7f8a-4e23-91c1-99f8e85210e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:25.060785 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c3d97-7f8a-4e23-91c1-99f8e85210e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:25.062377 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c3d97-7f8a-4e23-91c1-99f8e85210e3 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:25.072374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 571/1141] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:26.241342 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598da905-ed0d-4e9e-9da8-edc7e532568d None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:26.241863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598da905-ed0d-4e9e-9da8-edc7e532568d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:26.241863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598da905-ed0d-4e9e-9da8-edc7e532568d None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:26.243238 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 571/1142] 10.222.0.67 () {54 vars in 961 bytes} [Mon Jul 25 09:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:26.248366 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c9c7c-fc6e-4bb0-b7db-5174403f1b0c None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:26.248767 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c9c7c-fc6e-4bb0-b7db-5174403f1b0c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:26.248921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c9c7c-fc6e-4bb0-b7db-5174403f1b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:26.268058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-bf2c9c7c-fc6e-4bb0-b7db-5174403f1b0c None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:26.269233 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-bf2c9c7c-fc6e-4bb0-b7db-5174403f1b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:26.277610 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 572/1143] 10.222.0.67 () {58 vars in 1058 bytes} [Mon Jul 25 09:49:26 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:26.285425 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598da905-ed0d-4e9e-9da8-edc7e532568d None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:26.299208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598da905-ed0d-4e9e-9da8-edc7e532568d None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:26.304090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bd9ed-8219-496d-ad6b-017f734f7730 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87520f22c3e944b4912d94c52e6ce84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:26.304713 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd9ed-8219-496d-ad6b-017f734f7730 service placement] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:26.304997 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd9ed-8219-496d-ad6b-017f734f7730 service placement] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:26.305272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd9ed-8219-496d-ad6b-017f734f7730 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:26.313731 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bd9ed-8219-496d-ad6b-017f734f7730 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:26.315360 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bd9ed-8219-496d-ad6b-017f734f7730 service placement] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:26.325324 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 572/1144] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:26 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:36.263269 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=79 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:49:36.282907 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f189b-cb7e-48c1-ac00-133872d85145 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:36.283197 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f189b-cb7e-48c1-ac00-133872d85145 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:36.283478 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f189b-cb7e-48c1-ac00-133872d85145 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:36.284913 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:36.289788 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fab075-0639-46aa-b6f6-3b00925c2a90 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:36.290230 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fab075-0639-46aa-b6f6-3b00925c2a90 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:36.290325 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fab075-0639-46aa-b6f6-3b00925c2a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:36.309835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-52fab075-0639-46aa-b6f6-3b00925c2a90 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:36.311062 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-52fab075-0639-46aa-b6f6-3b00925c2a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:36.319718 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:49:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:36.480847 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f189b-cb7e-48c1-ac00-133872d85145 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:36.494974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f189b-cb7e-48c1-ac00-133872d85145 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:36.499999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78734d4-93ec-4301-b718-a9d38093ecf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:36.501374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78734d4-93ec-4301-b718-a9d38093ecf3 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:36.501662 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78734d4-93ec-4301-b718-a9d38093ecf3 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:36.501946 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78734d4-93ec-4301-b718-a9d38093ecf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:36.510422 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78734d4-93ec-4301-b718-a9d38093ecf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:36.512048 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78734d4-93ec-4301-b718-a9d38093ecf3 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:36.522218 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 574/1147] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:37.349320 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5b86-fbbd-4aa3-b67c-0c7e18066215 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:37.349817 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5b86-fbbd-4aa3-b67c-0c7e18066215 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:37.349930 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b5b86-fbbd-4aa3-b67c-0c7e18066215 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:37.351387 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 09:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:37.356605 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d30fb-298e-46fb-8799-9e482d9542a6 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:37.357023 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d30fb-298e-46fb-8799-9e482d9542a6 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:37.357240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d30fb-298e-46fb-8799-9e482d9542a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:37.377896 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-a59d30fb-298e-46fb-8799-9e482d9542a6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:37.379122 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-a59d30fb-298e-46fb-8799-9e482d9542a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:37.387726 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 09:49:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:37.544944 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b5b86-fbbd-4aa3-b67c-0c7e18066215 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:37.559222 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b5b86-fbbd-4aa3-b67c-0c7e18066215 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:37.564283 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf321df-add5-44b5-938d-02c7ca3a0b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:37.564921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf321df-add5-44b5-938d-02c7ca3a0b19 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:37.565208 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf321df-add5-44b5-938d-02c7ca3a0b19 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:37.565489 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf321df-add5-44b5-938d-02c7ca3a0b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:37.573963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf321df-add5-44b5-938d-02c7ca3a0b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:37.575585 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf321df-add5-44b5-938d-02c7ca3a0b19 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:37.585031 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 575/1150] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:41.707113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e133-0664-4cc2-b740-8ee82daf6d09 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:41.707113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e133-0664-4cc2-b740-8ee82daf6d09 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:41.707113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e133-0664-4cc2-b740-8ee82daf6d09 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:41.707113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:41.709245 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740cd6-c4ab-42e3-a0c2-b7035c4a1eb5 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:41.709628 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740cd6-c4ab-42e3-a0c2-b7035c4a1eb5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:41.709811 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740cd6-c4ab-42e3-a0c2-b7035c4a1eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:41.729121 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-63740cd6-c4ab-42e3-a0c2-b7035c4a1eb5 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:41.730314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-63740cd6-c4ab-42e3-a0c2-b7035c4a1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:41.738858 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:49:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:41.777712 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028e133-0664-4cc2-b740-8ee82daf6d09 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:41.779378 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-8028e133-0664-4cc2-b740-8ee82daf6d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:41.838517 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028e133-0664-4cc2-b740-8ee82daf6d09 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:41.842009 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b20629-a59f-4911-ba8c-318881d9ff15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:41.842752 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b20629-a59f-4911-ba8c-318881d9ff15 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:41.843113 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b20629-a59f-4911-ba8c-318881d9ff15 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:41.843405 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b20629-a59f-4911-ba8c-318881d9ff15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:41.852363 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b20629-a59f-4911-ba8c-318881d9ff15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:41.853815 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b20629-a59f-4911-ba8c-318881d9ff15 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:41.863644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 577/1153] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:44.080039 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb37b-306b-4836-823f-2b50d58cf1d1 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:44.080599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb37b-306b-4836-823f-2b50d58cf1d1 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:44.080599 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb37b-306b-4836-823f-2b50d58cf1d1 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:44.081876 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:44.087157 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1ca0-f321-4694-93dc-9bcd8a7d8e90 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:44.087592 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1ca0-f321-4694-93dc-9bcd8a7d8e90 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:44.087718 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f1ca0-f321-4694-93dc-9bcd8a7d8e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:44.106846 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-bd7f1ca0-f321-4694-93dc-9bcd8a7d8e90 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:44.108026 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-bd7f1ca0-f321-4694-93dc-9bcd8a7d8e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:44.116286 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:49:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:44.153639 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb37b-306b-4836-823f-2b50d58cf1d1 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:44.165040 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb37b-306b-4836-823f-2b50d58cf1d1 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:44.168586 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c2ea8-c498-4bf0-acd2-6418537c21ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:44.169218 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2ea8-c498-4bf0-acd2-6418537c21ef service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:44.169503 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2ea8-c498-4bf0-acd2-6418537c21ef service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:44.169786 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c2ea8-c498-4bf0-acd2-6418537c21ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:44.179498 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c2ea8-c498-4bf0-acd2-6418537c21ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:44.180952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c2ea8-c498-4bf0-acd2-6418537c21ef service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:44.190260 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 578/1156] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:48.092443 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffd71-77f0-45f0-94b0-07dd37f5ce22 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:48.092981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffd71-77f0-45f0-94b0-07dd37f5ce22 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:48.092981 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ffd71-77f0-45f0-94b0-07dd37f5ce22 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:48.094309 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 579/1157] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:49:48.099589 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d73b9-a8dd-4b3d-bd6e-ae0749aa5212 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:48.104868 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d73b9-a8dd-4b3d-bd6e-ae0749aa5212 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:48.104868 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d73b9-a8dd-4b3d-bd6e-ae0749aa5212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:48.119535 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-907d73b9-a8dd-4b3d-bd6e-ae0749aa5212 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:48.120716 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-907d73b9-a8dd-4b3d-bd6e-ae0749aa5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:48.129206 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 579/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:49:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:48.402438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ffd71-77f0-45f0-94b0-07dd37f5ce22 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:48.404248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-150ffd71-77f0-45f0-94b0-07dd37f5ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:48.462581 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ffd71-77f0-45f0-94b0-07dd37f5ce22 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:48.466058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c4ee7-1c83-4221-bccc-91cbf5c126f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c7977a3564cc1a9c0ff0f0dcc6df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:48.466725 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4ee7-1c83-4221-bccc-91cbf5c126f4 service cinder] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:48.467013 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4ee7-1c83-4221-bccc-91cbf5c126f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:48.467292 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4ee7-1c83-4221-bccc-91cbf5c126f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:48.476268 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c4ee7-1c83-4221-bccc-91cbf5c126f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:48.477712 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c4ee7-1c83-4221-bccc-91cbf5c126f4 service cinder] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:48.487854 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 580/1159] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:49:50.718856 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949564c7-36e5-4dd2-b634-b124446279f2 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:50.719455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949564c7-36e5-4dd2-b634-b124446279f2 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:50.719455 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949564c7-36e5-4dd2-b634-b124446279f2 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:50.720879 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 580/1160] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 09:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:49:50.726020 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92ba3-ae45-4317-892a-40d05e40eb2c None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:50.726423 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92ba3-ae45-4317-892a-40d05e40eb2c None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:50.726681 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92ba3-ae45-4317-892a-40d05e40eb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:50.747084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-73a92ba3-ae45-4317-892a-40d05e40eb2c None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:49:50.748290 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-73a92ba3-ae45-4317-892a-40d05e40eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:50.756801 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 581/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 09:49:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:49:51.028016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949564c7-36e5-4dd2-b634-b124446279f2 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:49:51.029705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-949564c7-36e5-4dd2-b634-b124446279f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:49:51.043042 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949564c7-36e5-4dd2-b634-b124446279f2 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:49:51.046711 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e3dc2-181f-4271-a195-b5b5de79fc16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362c7977a3564cc1a9c0ff0f0dcc6df6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:49:51.047402 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e3dc2-181f-4271-a195-b5b5de79fc16 service cinder] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:49:51.048202 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e3dc2-181f-4271-a195-b5b5de79fc16 service cinder] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:49:51.048202 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e3dc2-181f-4271-a195-b5b5de79fc16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:49:51.057077 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e3dc2-181f-4271-a195-b5b5de79fc16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:49:51.058532 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e3dc2-181f-4271-a195-b5b5de79fc16 service cinder] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:49:51.069013 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 581/1162] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:49:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:50:00.741721 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=67 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:50:01.064490 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=42 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:10.503543 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89e55-a305-4c28-bc05-173f496d13ac None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.504176 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89e55-a305-4c28-bc05-173f496d13ac None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.504176 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89e55-a305-4c28-bc05-173f496d13ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.524406 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-67c89e55-a305-4c28-bc05-173f496d13ac None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:10.525629 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-67c89e55-a305-4c28-bc05-173f496d13ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:10.531007 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acb8a8-6c77-4fa3-85ea-c31eb093dd1d None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.531531 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acb8a8-6c77-4fa3-85ea-c31eb093dd1d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.531652 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acb8a8-6c77-4fa3-85ea-c31eb093dd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.533831 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 582/1163] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:10.541908 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0852f5-1450-49d2-919d-6f5c53c3a2af None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.542205 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0852f5-1450-49d2-919d-6f5c53c3a2af None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.542520 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0852f5-1450-49d2-919d-6f5c53c3a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.551432 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-86acb8a8-6c77-4fa3-85ea-c31eb093dd1d None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:10.552653 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-86acb8a8-6c77-4fa3-85ea-c31eb093dd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:10.560705 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 582/1164] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:10.566078 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-3d0852f5-1450-49d2-919d-6f5c53c3a2af None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:10.568186 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-3d0852f5-1450-49d2-919d-6f5c53c3a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:10.569824 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d475f-06ed-4975-9a70-01433d8c3bd6 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.570120 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d475f-06ed-4975-9a70-01433d8c3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.570437 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d475f-06ed-4975-9a70-01433d8c3bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.581989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 583/1165] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:10.586176 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0852f5-1450-49d2-919d-6f5c53c3a2af None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:10.591828 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-fe4d475f-06ed-4975-9a70-01433d8c3bd6 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:10.593047 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-fe4d475f-06ed-4975-9a70-01433d8c3bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:10.595575 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0852f5-1450-49d2-919d-6f5c53c3a2af None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:10.600960 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:10.601307 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 583/1166] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:10.602071 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.602614 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.603094 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] PATH_INFO: `/v3/domains` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.604407 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93888) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:51:10.604999 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:10.605882 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d475f-06ed-4975-9a70-01433d8c3bd6 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:10.608088 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:10.615679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d475f-06ed-4975-9a70-01433d8c3bd6 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:10.620359 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:10.621013 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.621298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.621698 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 584/1167] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Jul 25 09:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:51:10.621822 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.622447 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93887) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 09:51:10.622790 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:10.623817 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WARNING py.warnings [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:51:10.623817 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: warnings.warn(msg) Jul 25 09:51:10.623817 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: Jul 25 09:51:10.624702 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:10.630347 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:10.642607 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 584/1168] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Jul 25 09:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 09:51:10.643620 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f956c-ff09-4f53-b413-505c9142d5ed admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:10.645594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:10.648297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:10.648945 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.649230 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.649507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.650190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:10.651253 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING py.warnings [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:51:10.651253 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: warnings.warn(msg) Jul 25 09:51:10.651253 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: Jul 25 09:51:10.652442 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:10.655306 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4c6ae-70cc-4b9b-87c2-375635207d00 admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:10.659932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047fef8-c4a1-4882-9539-fbe7d65aa9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:10.660584 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047fef8-c4a1-4882-9539-fbe7d65aa9ba admin admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.660872 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047fef8-c4a1-4882-9539-fbe7d65aa9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.661152 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047fef8-c4a1-4882-9539-fbe7d65aa9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.661840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047fef8-c4a1-4882-9539-fbe7d65aa9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:10.663771 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047fef8-c4a1-4882-9539-fbe7d65aa9ba admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:10.770340 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 585/1169] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Jul 25 09:51:10 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:51:10.774241 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:10.809788 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 585/1170] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Jul 25 09:51:10 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:51:10.813965 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047fef8-c4a1-4882-9539-fbe7d65aa9ba admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:10.839316 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d16692-408d-4b54-af99-655d82952404 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:10.879428 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047fef8-c4a1-4882-9539-fbe7d65aa9ba admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:10.884235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:10.889920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.889920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.889920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.889920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:10.889920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WARNING py.warnings [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:51:10.889920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: warnings.warn(msg) Jul 25 09:51:10.889920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: Jul 25 09:51:10.890644 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:10.896875 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67494a-eee5-45ea-8391-93be686a75f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:10.898049 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67494a-eee5-45ea-8391-93be686a75f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:10.898350 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67494a-eee5-45ea-8391-93be686a75f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:10.898670 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67494a-eee5-45ea-8391-93be686a75f6 admin admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:10.899369 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67494a-eee5-45ea-8391-93be686a75f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:10.901327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67494a-eee5-45ea-8391-93be686a75f6 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.008475 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 586/1171] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:51:10 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:51:11.012620 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:11.022985 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 586/1172] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:51:10 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:51:11.023169 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8025e1b-753e-4197-b2dc-a3a412d8951f admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:11.024022 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67494a-eee5-45ea-8391-93be686a75f6 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:11.027061 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6e2b-7be4-4aa3-95c2-297ea991b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:11.027722 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6e2b-7be4-4aa3-95c2-297ea991b2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.028006 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6e2b-7be4-4aa3-95c2-297ea991b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.028284 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca6e2b-7be4-4aa3-95c2-297ea991b2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.029087 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca6e2b-7be4-4aa3-95c2-297ea991b2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:11.030679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca6e2b-7be4-4aa3-95c2-297ea991b2a2 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.034702 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67494a-eee5-45ea-8391-93be686a75f6 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:11.040195 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0361-d90c-41d6-838c-eec48a51f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:11.040195 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0361-d90c-41d6-838c-eec48a51f90c admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.040583 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0361-d90c-41d6-838c-eec48a51f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.040867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0361-d90c-41d6-838c-eec48a51f90c admin admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.044367 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 587/1173] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:51:11.044517 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0361-d90c-41d6-838c-eec48a51f90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:11.044517 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0361-d90c-41d6-838c-eec48a51f90c admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.045169 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6e2b-7be4-4aa3-95c2-297ea991b2a2 admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:11.054808 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 587/1174] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:51:11.055401 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca6e2b-7be4-4aa3-95c2-297ea991b2a2 admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:11.058823 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0361-d90c-41d6-838c-eec48a51f90c admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:11.061829 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c91c6-9e91-4aa9-940e-349cac97e8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:11.062876 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c91c6-9e91-4aa9-940e-349cac97e8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.063165 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c91c6-9e91-4aa9-940e-349cac97e8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.063454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c91c6-9e91-4aa9-940e-349cac97e8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.064662 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c91c6-9e91-4aa9-940e-349cac97e8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:11.066977 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c91c6-9e91-4aa9-940e-349cac97e8d9 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.069058 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0361-d90c-41d6-838c-eec48a51f90c admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:11.073735 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9924d8-b727-4fd2-adf5-831c671067c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:11.074388 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9924d8-b727-4fd2-adf5-831c671067c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.074715 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9924d8-b727-4fd2-adf5-831c671067c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.075002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9924d8-b727-4fd2-adf5-831c671067c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.075722 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9924d8-b727-4fd2-adf5-831c671067c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:11.077385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9924d8-b727-4fd2-adf5-831c671067c7 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.078137 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 588/1175] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:51:11.083106 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c91c6-9e91-4aa9-940e-349cac97e8d9 admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:11.091590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 588/1176] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:51:11.092803 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9924d8-b727-4fd2-adf5-831c671067c7 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:11.092937 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c91c6-9e91-4aa9-940e-349cac97e8d9 admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:11.098066 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcb426-975e-42da-baac-7e9c73706c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:11.098987 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb426-975e-42da-baac-7e9c73706c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.099271 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb426-975e-42da-baac-7e9c73706c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.099553 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb426-975e-42da-baac-7e9c73706c27 admin admin] PATH_INFO: `/v3/projects/47498626fdb447ceaba2c0d196d14501/users/a86e12c3821d4ec59d69bb98c65a7694/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.103574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9924d8-b727-4fd2-adf5-831c671067c7 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:11.108385 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bec78-378b-4515-9967-7723ee3785a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:11.109288 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bec78-378b-4515-9967-7723ee3785a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.114836 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bec78-378b-4515-9967-7723ee3785a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.114836 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bec78-378b-4515-9967-7723ee3785a5 admin admin] PATH_INFO: `/v3/projects/7fbf72e6f60d4aca85f3929f35afb868/users/88956186c94d4b0a8d8de99d6bd24ccd/roles/c96e5110ca5c4ed68198a5df1ce6d04f` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.116254 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb426-975e-42da-baac-7e9c73706c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47498626fdb447ceaba2c0d196d14501, user_id=a86e12c3821d4ec59d69bb98c65a7694, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:11.119395 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb426-975e-42da-baac-7e9c73706c27 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.125323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bec78-378b-4515-9967-7723ee3785a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbf72e6f60d4aca85f3929f35afb868, user_id=88956186c94d4b0a8d8de99d6bd24ccd, role_id=c96e5110ca5c4ed68198a5df1ce6d04f)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:11.126661 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING py.warnings [None req-901bec78-378b-4515-9967-7723ee3785a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:51:11.126661 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: warnings.warn(msg) Jul 25 09:51:11.126661 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: Jul 25 09:51:11.128580 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bec78-378b-4515-9967-7723ee3785a5 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.209122 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 589/1177] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Jul 25 09:51:11 2022] PUT /identity/v3/projects/47498626fdb447ceaba2c0d196d14501/users/a86e12c3821d4ec59d69bb98c65a7694/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:51:11.214290 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b78ef-9dd2-47f1-8264-6a9166b95fd5 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.214638 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b78ef-9dd2-47f1-8264-6a9166b95fd5 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.214929 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b78ef-9dd2-47f1-8264-6a9166b95fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.231894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 589/1178] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Jul 25 09:51:11 2022] PUT /identity/v3/projects/7fbf72e6f60d4aca85f3929f35afb868/users/88956186c94d4b0a8d8de99d6bd24ccd/roles/c96e5110ca5c4ed68198a5df1ce6d04f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:51:11.234371 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-7c6b78ef-9dd2-47f1-8264-6a9166b95fd5 None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:11.235646 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-7c6b78ef-9dd2-47f1-8264-6a9166b95fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:11.237887 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6ecd-21ba-4bcd-8e03-e516ec1db30b None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.238188 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6ecd-21ba-4bcd-8e03-e516ec1db30b None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.238495 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6ecd-21ba-4bcd-8e03-e516ec1db30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.245597 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:11.258364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-802c6ecd-21ba-4bcd-8e03-e516ec1db30b None None] MFA Rules not processed for user `c2c0cf22337e45c78e8cb5635c37dbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:11.259728 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-802c6ecd-21ba-4bcd-8e03-e516ec1db30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:11.289976 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:11.301487 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 590/1179] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:11.311737 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b78ef-9dd2-47f1-8264-6a9166b95fd5 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:11.313118 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-7c6b78ef-9dd2-47f1-8264-6a9166b95fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:11.320934 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 590/1180] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:11.331565 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c6ecd-21ba-4bcd-8e03-e516ec1db30b None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:11.333147 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-802c6ecd-21ba-4bcd-8e03-e516ec1db30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:11.371683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b78ef-9dd2-47f1-8264-6a9166b95fd5 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:11.375170 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f658e77-e897-4a39-90ea-efbd3002c8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:11.375900 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f658e77-e897-4a39-90ea-efbd3002c8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.376298 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f658e77-e897-4a39-90ea-efbd3002c8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.376578 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f658e77-e897-4a39-90ea-efbd3002c8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.385358 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f658e77-e897-4a39-90ea-efbd3002c8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:11.386808 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f658e77-e897-4a39-90ea-efbd3002c8e2 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.390696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c6ecd-21ba-4bcd-8e03-e516ec1db30b None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:11.395427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0559b-2964-436b-9bf8-b7cff78c3f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:11.396209 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0559b-2964-436b-9bf8-b7cff78c3f50 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:11.396505 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0559b-2964-436b-9bf8-b7cff78c3f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:11.396787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0559b-2964-436b-9bf8-b7cff78c3f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:11.397627 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 591/1181] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:51:11.406837 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0559b-2964-436b-9bf8-b7cff78c3f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:11.409068 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0559b-2964-436b-9bf8-b7cff78c3f50 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:11.418979 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 591/1182] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:51:18.014068 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295da8-9d8c-4ba2-abd0-3e7db5bb787d None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.014991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295da8-9d8c-4ba2-abd0-3e7db5bb787d None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.015480 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295da8-9d8c-4ba2-abd0-3e7db5bb787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.081166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-41295da8-9d8c-4ba2-abd0-3e7db5bb787d None None] MFA Rules not processed for user `88956186c94d4b0a8d8de99d6bd24ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:18.082690 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-41295da8-9d8c-4ba2-abd0-3e7db5bb787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:18.204804 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 592/1183] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:18 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:18.214396 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0559b-2964-436b-9bf8-b7cff78c3f50 service neutron] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.230330 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0559b-2964-436b-9bf8-b7cff78c3f50 service neutron] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.237567 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21c476-1a62-45c9-9f4e-96891a85a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.237789 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21c476-1a62-45c9-9f4e-96891a85a985 admin admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.238080 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21c476-1a62-45c9-9f4e-96891a85a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.238364 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21c476-1a62-45c9-9f4e-96891a85a985 admin admin] PATH_INFO: `/v3/projects` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.239183 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21c476-1a62-45c9-9f4e-96891a85a985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.241194 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21c476-1a62-45c9-9f4e-96891a85a985 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:18.254338 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2f02-ac10-4e20-b08d-b0e5df9492bf None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.254667 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2f02-ac10-4e20-b08d-b0e5df9492bf None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.254955 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2f02-ac10-4e20-b08d-b0e5df9492bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.295140 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-710f2f02-ac10-4e20-b08d-b0e5df9492bf None None] MFA Rules not processed for user `a86e12c3821d4ec59d69bb98c65a7694`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:18.296366 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-710f2f02-ac10-4e20-b08d-b0e5df9492bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:18.366787 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 592/1184] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Jul 25 09:51:18 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:51:18.367690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21c476-1a62-45c9-9f4e-96891a85a985 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.376272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 593/1185] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:18 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:18.380551 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f2f02-ac10-4e20-b08d-b0e5df9492bf None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.392025 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f2f02-ac10-4e20-b08d-b0e5df9492bf None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.407945 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:18.442027 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21c476-1a62-45c9-9f4e-96891a85a985 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.447585 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ca77-6eb9-47f0-a367-757e877e335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.448644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ca77-6eb9-47f0-a367-757e877e335c admin admin] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.449379 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ca77-6eb9-47f0-a367-757e877e335c admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.449829 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ca77-6eb9-47f0-a367-757e877e335c admin admin] PATH_INFO: `/v3/users` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.450728 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8ca77-6eb9-47f0-a367-757e877e335c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.452845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8ca77-6eb9-47f0-a367-757e877e335c admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:18.460941 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe6c44-9bf9-4661-ad00-2ff5020ca83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.461709 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe6c44-9bf9-4661-ad00-2ff5020ca83b admin admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.462220 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe6c44-9bf9-4661-ad00-2ff5020ca83b admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.462545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe6c44-9bf9-4661-ad00-2ff5020ca83b admin admin] PATH_INFO: `/v3/projects` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.464149 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe6c44-9bf9-4661-ad00-2ff5020ca83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.466884 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe6c44-9bf9-4661-ad00-2ff5020ca83b admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:18.590123 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 593/1186] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:51:18 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:51:18.594114 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ca77-6eb9-47f0-a367-757e877e335c admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.605386 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ca77-6eb9-47f0-a367-757e877e335c admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.610634 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb3233-6f81-4e7c-be63-ac29da6d79b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.611333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb3233-6f81-4e7c-be63-ac29da6d79b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.611643 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb3233-6f81-4e7c-be63-ac29da6d79b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.611923 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb3233-6f81-4e7c-be63-ac29da6d79b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.612658 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb3233-6f81-4e7c-be63-ac29da6d79b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.614266 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb3233-6f81-4e7c-be63-ac29da6d79b8 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:18.627136 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 594/1187] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 09:51:18.639126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb3233-6f81-4e7c-be63-ac29da6d79b8 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.639126 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:18.644690 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb3233-6f81-4e7c-be63-ac29da6d79b8 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.648860 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 594/1188] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Jul 25 09:51:18 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 09:51:18.650829 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe6c44-9bf9-4661-ad00-2ff5020ca83b admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.715952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cb600-4844-4a51-b4ac-6b1b14d72168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.716805 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cb600-4844-4a51-b4ac-6b1b14d72168 admin admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.717501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cb600-4844-4a51-b4ac-6b1b14d72168 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.717501 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cb600-4844-4a51-b4ac-6b1b14d72168 admin admin] PATH_INFO: `/v3/projects/a0dc33ddc9084144a285da90a6ba87af/users/613e2d60fd504b239e063b444bb765c5/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.739365 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cb600-4844-4a51-b4ac-6b1b14d72168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dc33ddc9084144a285da90a6ba87af, user_id=613e2d60fd504b239e063b444bb765c5, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.742168 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cb600-4844-4a51-b4ac-6b1b14d72168 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:18.742625 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe6c44-9bf9-4661-ad00-2ff5020ca83b admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.748419 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedd99b-7c65-499f-9ec7-cdd59719edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.749223 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd99b-7c65-499f-9ec7-cdd59719edde admin admin] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.749545 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd99b-7c65-499f-9ec7-cdd59719edde admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.749894 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd99b-7c65-499f-9ec7-cdd59719edde admin admin] PATH_INFO: `/v3/users` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.751412 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedd99b-7c65-499f-9ec7-cdd59719edde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.753679 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedd99b-7c65-499f-9ec7-cdd59719edde admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:18.862374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 595/1189] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Jul 25 09:51:18 2022] PUT /identity/v3/projects/a0dc33ddc9084144a285da90a6ba87af/users/613e2d60fd504b239e063b444bb765c5/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:51:18.869342 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cb600-4844-4a51-b4ac-6b1b14d72168 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.893529 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 595/1190] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Jul 25 09:51:18 2022] POST /identity/v3/users => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 09:51:18.897506 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedd99b-7c65-499f-9ec7-cdd59719edde admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.909528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedd99b-7c65-499f-9ec7-cdd59719edde admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.949775 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cb600-4844-4a51-b4ac-6b1b14d72168 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.952102 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02277af3-13fd-49b0-8cae-016987bc895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.952808 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02277af3-13fd-49b0-8cae-016987bc895e admin admin] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.953109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02277af3-13fd-49b0-8cae-016987bc895e admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.953372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02277af3-13fd-49b0-8cae-016987bc895e admin admin] PATH_INFO: `/v3/roles` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.954763 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02277af3-13fd-49b0-8cae-016987bc895e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.956381 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02277af3-13fd-49b0-8cae-016987bc895e admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:18.970877 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 596/1191] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:51:18.971880 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02277af3-13fd-49b0-8cae-016987bc895e admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:18.982219 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02277af3-13fd-49b0-8cae-016987bc895e admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:18.985560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88a98a-fad9-4f77-a9e4-71c2f53739d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.986341 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a98a-fad9-4f77-a9e4-71c2f53739d6 admin admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.986667 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a98a-fad9-4f77-a9e4-71c2f53739d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.986955 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a98a-fad9-4f77-a9e4-71c2f53739d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.987089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a3f08-989b-40cd-a627-d31b1c1720c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:18.987706 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88a98a-fad9-4f77-a9e4-71c2f53739d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.987989 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3f08-989b-40cd-a627-d31b1c1720c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:18.988277 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3f08-989b-40cd-a627-d31b1c1720c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:18.988552 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a3f08-989b-40cd-a627-d31b1c1720c5 admin admin] PATH_INFO: `/v3/projects/a0dc33ddc9084144a285da90a6ba87af/users/613e2d60fd504b239e063b444bb765c5/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:18.989385 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88a98a-fad9-4f77-a9e4-71c2f53739d6 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:18.990558 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a3f08-989b-40cd-a627-d31b1c1720c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0dc33ddc9084144a285da90a6ba87af, user_id=613e2d60fd504b239e063b444bb765c5, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:18.993222 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a3f08-989b-40cd-a627-d31b1c1720c5 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:19.012166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 597/1192] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Jul 25 09:51:18 2022] PUT /identity/v3/projects/a0dc33ddc9084144a285da90a6ba87af/users/613e2d60fd504b239e063b444bb765c5/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:51:19.022124 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 596/1193] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:51:19.027964 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a3f08-989b-40cd-a627-d31b1c1720c5 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:19.134272 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a3f08-989b-40cd-a627-d31b1c1720c5 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:19.145154 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b32e9-b546-454c-98fe-870692b3c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:19.149845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b32e9-b546-454c-98fe-870692b3c8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:19.150139 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b32e9-b546-454c-98fe-870692b3c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:19.150424 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b32e9-b546-454c-98fe-870692b3c8ef admin admin] PATH_INFO: `/v3/projects/e7e494ceeaac4fd1889a019370def04b/users/daad05ea96aa4e83a1c5d4888623055e/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:19.177500 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:19.189947 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b32e9-b546-454c-98fe-870692b3c8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e494ceeaac4fd1889a019370def04b, user_id=daad05ea96aa4e83a1c5d4888623055e, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:19.193240 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b32e9-b546-454c-98fe-870692b3c8ef admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:19.288660 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 598/1194] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Jul 25 09:51:19 2022] PUT /identity/v3/projects/e7e494ceeaac4fd1889a019370def04b/users/daad05ea96aa4e83a1c5d4888623055e/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:51:19.292970 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88a98a-fad9-4f77-a9e4-71c2f53739d6 admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:19.304473 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88a98a-fad9-4f77-a9e4-71c2f53739d6 admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:19.341113 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:19.391220 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0002e31-c126-4ab1-892b-547fb73ebc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:19.392582 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0002e31-c126-4ab1-892b-547fb73ebc79 admin admin] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:19.392869 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0002e31-c126-4ab1-892b-547fb73ebc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:19.393166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0002e31-c126-4ab1-892b-547fb73ebc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:19.394403 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0002e31-c126-4ab1-892b-547fb73ebc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:19.401196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0002e31-c126-4ab1-892b-547fb73ebc79 admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:19.418760 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 597/1195] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Jul 25 09:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 09:51:19.420234 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b32e9-b546-454c-98fe-870692b3c8ef admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:19.436645 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b32e9-b546-454c-98fe-870692b3c8ef admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:19.443069 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:19.444963 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:19.445762 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:19.446109 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] PATH_INFO: `/v3/projects/e7e494ceeaac4fd1889a019370def04b/users/daad05ea96aa4e83a1c5d4888623055e/roles/bd8b88fae376413398183761500b2e1d` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:19.448456 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e494ceeaac4fd1889a019370def04b, user_id=daad05ea96aa4e83a1c5d4888623055e, role_id=bd8b88fae376413398183761500b2e1d)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:19.451626 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:19.468384 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 599/1196] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Jul 25 09:51:19 2022] PUT /identity/v3/projects/e7e494ceeaac4fd1889a019370def04b/users/daad05ea96aa4e83a1c5d4888623055e/roles/bd8b88fae376413398183761500b2e1d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:51:26.384795 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879fec-97f2-4536-a245-4e36c59a23d6 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:26.385314 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879fec-97f2-4536-a245-4e36c59a23d6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:26.385397 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879fec-97f2-4536-a245-4e36c59a23d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:26.430044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-8b879fec-97f2-4536-a245-4e36c59a23d6 None None] MFA Rules not processed for user `613e2d60fd504b239e063b444bb765c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:26.432459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-8b879fec-97f2-4536-a245-4e36c59a23d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:26.543506 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 598/1197] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:26 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:26.553571 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:26.555450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:26.637707 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35c54-c969-4871-8494-1d364aa3b9a8 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:26.645584 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a37d87-15f7-4de7-aac4-932a6db74220 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17097c198d491198553e03fd8e8327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:26.646949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37d87-15f7-4de7-aac4-932a6db74220 service glance] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:26.646949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37d87-15f7-4de7-aac4-932a6db74220 service glance] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:26.646949 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37d87-15f7-4de7-aac4-932a6db74220 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:26.729636 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a37d87-15f7-4de7-aac4-932a6db74220 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:26.731427 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a37d87-15f7-4de7-aac4-932a6db74220 service glance] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:26.746313 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 600/1198] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:26 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:51:27.445890 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e369574-ff2d-4e17-95c9-70c7bea32a79 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:27.446398 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e369574-ff2d-4e17-95c9-70c7bea32a79 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:27.446813 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e369574-ff2d-4e17-95c9-70c7bea32a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:27.477503 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-5e369574-ff2d-4e17-95c9-70c7bea32a79 None None] MFA Rules not processed for user `daad05ea96aa4e83a1c5d4888623055e`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:27.478785 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-5e369574-ff2d-4e17-95c9-70c7bea32a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:27.574635 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 599/1199] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:27 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:27.598850 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a37d87-15f7-4de7-aac4-932a6db74220 service glance] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:27.610188 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a37d87-15f7-4de7-aac4-932a6db74220 service glance] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:27.615472 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb267af-426b-4f26-94b9-e1e27179ddb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17097c198d491198553e03fd8e8327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:27.616424 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb267af-426b-4f26-94b9-e1e27179ddb4 service glance] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:27.616921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb267af-426b-4f26-94b9-e1e27179ddb4 service glance] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:27.617425 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb267af-426b-4f26-94b9-e1e27179ddb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:27.702104 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb267af-426b-4f26-94b9-e1e27179ddb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:27.703710 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb267af-426b-4f26-94b9-e1e27179ddb4 service glance] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:27.712986 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 601/1200] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:27 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:51:37.180688 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41cea-c425-4fa3-95ac-1cb858035203 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:37.181292 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41cea-c425-4fa3-95ac-1cb858035203 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:37.181292 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41cea-c425-4fa3-95ac-1cb858035203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:37.201260 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-9ce41cea-c425-4fa3-95ac-1cb858035203 None None] MFA Rules not processed for user `a86e12c3821d4ec59d69bb98c65a7694`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:37.202480 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-9ce41cea-c425-4fa3-95ac-1cb858035203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:37.210287 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 600/1201] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:51:37 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:37.510897 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e92a4-7ec8-4de3-ab9d-40c6734949d9 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:37.513729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e92a4-7ec8-4de3-ab9d-40c6734949d9 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:37.513729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e92a4-7ec8-4de3-ab9d-40c6734949d9 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:37.513729 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 602/1202] 10.222.0.67 () {54 vars in 962 bytes} [Mon Jul 25 09:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:51:37.518818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ef18-6e33-4e8d-a504-1cd1312eea68 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:37.518818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ef18-6e33-4e8d-a504-1cd1312eea68 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:37.519110 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ef18-6e33-4e8d-a504-1cd1312eea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:37.542765 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-eac0ef18-6e33-4e8d-a504-1cd1312eea68 None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:37.543419 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-eac0ef18-6e33-4e8d-a504-1cd1312eea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:37.577017 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:37.619554 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 601/1203] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Jul 25 09:51:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:37.625861 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f4ee0-8096-41cf-9655-f179213d1fb7 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:37.626211 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f4ee0-8096-41cf-9655-f179213d1fb7 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:37.628414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f4ee0-8096-41cf-9655-f179213d1fb7 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:37.628414 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 603/1204] 10.222.0.67 () {54 vars in 912 bytes} [Mon Jul 25 09:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:51:37.633505 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13cb7-e06e-4cf5-9901-031746c2dde9 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:37.633804 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13cb7-e06e-4cf5-9901-031746c2dde9 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:37.634090 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13cb7-e06e-4cf5-9901-031746c2dde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:37.656840 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-28f13cb7-e06e-4cf5-9901-031746c2dde9 None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:37.658079 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-28f13cb7-e06e-4cf5-9901-031746c2dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:37.667189 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 602/1205] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Jul 25 09:51:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:37.679769 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f4ee0-8096-41cf-9655-f179213d1fb7 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:37.681509 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-ae0f4ee0-8096-41cf-9655-f179213d1fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:37.699616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f4ee0-8096-41cf-9655-f179213d1fb7 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:37.703239 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a4470-e0d0-4a3d-a37b-b180077bd5f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17097c198d491198553e03fd8e8327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:37.703878 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4470-e0d0-4a3d-a37b-b180077bd5f9 service glance] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:37.704171 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4470-e0d0-4a3d-a37b-b180077bd5f9 service glance] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:37.704446 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a4470-e0d0-4a3d-a37b-b180077bd5f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:37.714807 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a4470-e0d0-4a3d-a37b-b180077bd5f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:37.716253 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a4470-e0d0-4a3d-a37b-b180077bd5f9 service glance] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:37.727235 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 604/1206] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:51:38.078096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed55e-3ec0-4d25-9e2c-4157eb07dd59 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.078392 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed55e-3ec0-4d25-9e2c-4157eb07dd59 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.078727 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed55e-3ec0-4d25-9e2c-4157eb07dd59 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.080111 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 603/1207] 10.222.0.67 () {54 vars in 912 bytes} [Mon Jul 25 09:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:51:38.085293 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29664-ee87-4936-a6ad-97b8337ca8aa None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.085588 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29664-ee87-4936-a6ad-97b8337ca8aa None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.085879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29664-ee87-4936-a6ad-97b8337ca8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.106166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-78b29664-ee87-4936-a6ad-97b8337ca8aa None None] MFA Rules not processed for user `3969b99ab3b9410388d56dda5a4e15e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:38.107412 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-78b29664-ee87-4936-a6ad-97b8337ca8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:38.120670 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:38.160894 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 605/1208] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Jul 25 09:51:38 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:38.171942 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ed55e-3ec0-4d25-9e2c-4157eb07dd59 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:38.183259 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ed55e-3ec0-4d25-9e2c-4157eb07dd59 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:38.186929 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9c7e7-91cd-4d71-8d68-ad6cb633e5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:38.187829 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9c7e7-91cd-4d71-8d68-ad6cb633e5ec service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.188125 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9c7e7-91cd-4d71-8d68-ad6cb633e5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.188404 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9c7e7-91cd-4d71-8d68-ad6cb633e5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.195996 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9c7e7-91cd-4d71-8d68-ad6cb633e5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:38.197407 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9c7e7-91cd-4d71-8d68-ad6cb633e5ec service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:38.205804 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 604/1209] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:38 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:51:38.817261 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb837-1e24-4036-bf57-f854565aaf25 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.817261 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb837-1e24-4036-bf57-f854565aaf25 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.817261 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb837-1e24-4036-bf57-f854565aaf25 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.818606 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 606/1210] 10.222.0.67 () {54 vars in 962 bytes} [Mon Jul 25 09:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:51:38.820337 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8e31-b794-4a14-88a9-4dd1fae5c333 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.820633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8e31-b794-4a14-88a9-4dd1fae5c333 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.820916 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8e31-b794-4a14-88a9-4dd1fae5c333 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.822413 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 605/1211] 10.222.0.67 () {54 vars in 961 bytes} [Mon Jul 25 09:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:51:38.824015 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bef87-7b78-41fc-a47b-68d5b23b9d3a None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.824302 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bef87-7b78-41fc-a47b-68d5b23b9d3a None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.824580 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bef87-7b78-41fc-a47b-68d5b23b9d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.828729 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9e1f-b84b-4d6d-8c18-b4cf08a67390 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.828989 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9e1f-b84b-4d6d-8c18-b4cf08a67390 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.829272 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9e1f-b84b-4d6d-8c18-b4cf08a67390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.845958 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-326bef87-7b78-41fc-a47b-68d5b23b9d3a None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:38.847297 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-326bef87-7b78-41fc-a47b-68d5b23b9d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:38.850963 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-284c9e1f-b84b-4d6d-8c18-b4cf08a67390 None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:38.852369 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-284c9e1f-b84b-4d6d-8c18-b4cf08a67390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:38.856438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 607/1212] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Jul 25 09:51:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:38.862182 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fc19-3ac5-4122-aec5-19bae3f155dd None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.862539 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fc19-3ac5-4122-aec5-19bae3f155dd None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.862935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160fc19-3ac5-4122-aec5-19bae3f155dd None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.868562 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 608/1213] 10.222.0.67 () {54 vars in 912 bytes} [Mon Jul 25 09:51:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 09:51:38.873757 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b614-9408-4520-8cd6-0161ed94f4ac None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.874289 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b614-9408-4520-8cd6-0161ed94f4ac None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.874713 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9b614-9408-4520-8cd6-0161ed94f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.896561 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-64c9b614-9408-4520-8cd6-0161ed94f4ac None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:38.897952 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-64c9b614-9408-4520-8cd6-0161ed94f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:38.907302 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 609/1214] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Jul 25 09:51:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:38.920574 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b614-9408-4520-8cd6-0161ed94f4ac None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:38.932948 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9b614-9408-4520-8cd6-0161ed94f4ac None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:38.936317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 606/1215] 10.222.0.67 () {58 vars in 1058 bytes} [Mon Jul 25 09:51:38 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:38.936935 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2584a-9589-4baa-b7f9-383fa3c989d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:38.938246 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2584a-9589-4baa-b7f9-383fa3c989d7 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.938563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2584a-9589-4baa-b7f9-383fa3c989d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.938845 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2584a-9589-4baa-b7f9-383fa3c989d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.945826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c9e1f-b84b-4d6d-8c18-b4cf08a67390 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:38.949466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2584a-9589-4baa-b7f9-383fa3c989d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:38.950861 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2584a-9589-4baa-b7f9-383fa3c989d7 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:38.957166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c9e1f-b84b-4d6d-8c18-b4cf08a67390 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:38.962701 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 610/1216] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:51:38.965292 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87520f22c3e944b4912d94c52e6ce84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:38.969683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:38.969683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:38.969683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:38.969683 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:38.981861 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:38.983780 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:38.994907 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 607/1217] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:51:48.957089 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=27 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:48.990377 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=60 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:51:49.778649 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a332-271c-47e8-91bf-4c374b7b9a64 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:49.779282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a332-271c-47e8-91bf-4c374b7b9a64 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:49.779854 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7a332-271c-47e8-91bf-4c374b7b9a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:49.812044 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-bae7a332-271c-47e8-91bf-4c374b7b9a64 None None] MFA Rules not processed for user `3969b99ab3b9410388d56dda5a4e15e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:49.827008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-bae7a332-271c-47e8-91bf-4c374b7b9a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:49.827008 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 611/1218] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Jul 25 09:51:49 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:49.833283 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:49.842745 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622b0e-9948-4e28-b58c-9811d5d3293e service placement] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:49.847594 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fc4ec-4d1d-44fe-9050-5b4a9f16f038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:49.848247 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc4ec-4d1d-44fe-9050-5b4a9f16f038 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:49.848726 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc4ec-4d1d-44fe-9050-5b4a9f16f038 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:49.849015 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fc4ec-4d1d-44fe-9050-5b4a9f16f038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:49.856362 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fc4ec-4d1d-44fe-9050-5b4a9f16f038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:49.857788 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fc4ec-4d1d-44fe-9050-5b4a9f16f038 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:49.866517 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 608/1219] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:49 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 09:51:50.883121 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a62b6b-2d20-4e5e-88ed-d500af8b68be None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:50.884708 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a62b6b-2d20-4e5e-88ed-d500af8b68be None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:50.885220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a62b6b-2d20-4e5e-88ed-d500af8b68be None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:50.888905 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 612/1220] 10.222.0.67 () {54 vars in 921 bytes} [Mon Jul 25 09:51:50 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:51:50.895021 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb8e9-c754-4eac-8e8a-c876994dcf60 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:50.895893 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb8e9-c754-4eac-8e8a-c876994dcf60 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:50.896194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb8e9-c754-4eac-8e8a-c876994dcf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:50.919080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-1fffb8e9-c754-4eac-8e8a-c876994dcf60 None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:50.923194 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-1fffb8e9-c754-4eac-8e8a-c876994dcf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:50.940853 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 609/1221] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Jul 25 09:51:50 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:51:50.957965 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a62b6b-2d20-4e5e-88ed-d500af8b68be None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:50.983264 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a62b6b-2d20-4e5e-88ed-d500af8b68be None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:50.988856 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36eb39a-ab30-4a6a-a22f-89b91c2250d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:50.989527 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb39a-ab30-4a6a-a22f-89b91c2250d2 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:50.989814 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb39a-ab30-4a6a-a22f-89b91c2250d2 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:50.990099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36eb39a-ab30-4a6a-a22f-89b91c2250d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:50.999885 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eb39a-ab30-4a6a-a22f-89b91c2250d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:51.002974 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36eb39a-ab30-4a6a-a22f-89b91c2250d2 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:51.014409 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 613/1222] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:50 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:51:57.827528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4bb08-6e87-4616-8264-0e2854c3a390 None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:57.827528 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4bb08-6e87-4616-8264-0e2854c3a390 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:57.828242 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4bb08-6e87-4616-8264-0e2854c3a390 None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:57.829376 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 610/1223] 10.222.0.67 () {54 vars in 921 bytes} [Mon Jul 25 09:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:51:57.840531 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e6fd-ee43-49ce-927e-88a1e42a54bf None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:57.841004 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e6fd-ee43-49ce-927e-88a1e42a54bf None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:57.841004 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0e6fd-ee43-49ce-927e-88a1e42a54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:57.860910 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-f1e0e6fd-ee43-49ce-927e-88a1e42a54bf None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:51:57.862119 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-f1e0e6fd-ee43-49ce-927e-88a1e42a54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:51:57.870893 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 614/1224] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Jul 25 09:51:57 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:51:57.884860 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4bb08-6e87-4616-8264-0e2854c3a390 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:51:57.904016 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4bb08-6e87-4616-8264-0e2854c3a390 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:51:57.910554 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8753dc-c809-4f80-a396-eaf3c924d0b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:51:57.911863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8753dc-c809-4f80-a396-eaf3c924d0b5 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:51:57.911863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8753dc-c809-4f80-a396-eaf3c924d0b5 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:51:57.911863 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8753dc-c809-4f80-a396-eaf3c924d0b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:51:57.923246 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8753dc-c809-4f80-a396-eaf3c924d0b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:51:57.924764 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8753dc-c809-4f80-a396-eaf3c924d0b5 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:51:57.935825 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 611/1225] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:51:57 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:52:07.855428 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=12 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:52:07.931459 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=15 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:52:16.916840 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0e6fd-ee43-49ce-927e-88a1e42a54bf None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:52:16.926133 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0e6fd-ee43-49ce-927e-88a1e42a54bf None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:52:16.929621 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d68f-a52f-4c81-9d20-607ae3b3c8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:52:16.930263 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d68f-a52f-4c81-9d20-607ae3b3c8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:52:16.930590 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d68f-a52f-4c81-9d20-607ae3b3c8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:52:16.930880 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d68f-a52f-4c81-9d20-607ae3b3c8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:52:16.940930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44d68f-a52f-4c81-9d20-607ae3b3c8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:52:16.942373 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44d68f-a52f-4c81-9d20-607ae3b3c8f7 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:52:16.952035 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 615/1226] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:52:16 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:52:26.947788 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=6 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:53:28.165159 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816f69-f35a-429f-9eac-f316d4ea34c4 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:53:28.165660 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816f69-f35a-429f-9eac-f316d4ea34c4 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:53:28.165752 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816f69-f35a-429f-9eac-f316d4ea34c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:53:28.193951 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-04816f69-f35a-429f-9eac-f316d4ea34c4 None None] MFA Rules not processed for user `88956186c94d4b0a8d8de99d6bd24ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:53:28.195168 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-04816f69-f35a-429f-9eac-f316d4ea34c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:53:28.218809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 612/1227] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:53:28 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:53:28.521002 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54b58a-763b-4b51-a2d9-022307e34dc6 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:53:28.521507 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54b58a-763b-4b51-a2d9-022307e34dc6 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:53:28.521599 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54b58a-763b-4b51-a2d9-022307e34dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:53:28.709382 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-6d54b58a-763b-4b51-a2d9-022307e34dc6 None None] MFA Rules not processed for user `3969b99ab3b9410388d56dda5a4e15e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:53:28.710553 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-6d54b58a-763b-4b51-a2d9-022307e34dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:53:28.744802 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 616/1228] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Jul 25 09:53:28 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:53:28.756415 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04816f69-f35a-429f-9eac-f316d4ea34c4 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:53:28.765782 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04816f69-f35a-429f-9eac-f316d4ea34c4 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:53:28.769315 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19af80-5f6c-4660-b675-b3748bedf2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:53:28.769952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19af80-5f6c-4660-b675-b3748bedf2df service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:53:28.770238 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19af80-5f6c-4660-b675-b3748bedf2df service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:53:28.770568 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19af80-5f6c-4660-b675-b3748bedf2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:53:28.777481 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19af80-5f6c-4660-b675-b3748bedf2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:53:28.778954 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19af80-5f6c-4660-b675-b3748bedf2df service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:53:28.787110 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 613/1229] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:53:28 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:53:38.741945 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=28 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:53:38.783725 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=21 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:54:08.795181 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa763-2f97-438d-8bcb-cf6dd28b2254 None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:54:08.795681 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa763-2f97-438d-8bcb-cf6dd28b2254 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:54:08.795767 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa763-2f97-438d-8bcb-cf6dd28b2254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:54:08.815154 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-e00fa763-2f97-438d-8bcb-cf6dd28b2254 None None] MFA Rules not processed for user `88956186c94d4b0a8d8de99d6bd24ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:54:08.816374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-e00fa763-2f97-438d-8bcb-cf6dd28b2254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:54:08.823372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 617/1230] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:54:08 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:54:18.809990 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=3 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:54:26.703150 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42cb4-cc28-4481-8b5a-b075bbf38bb6 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:54:26.703635 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42cb4-cc28-4481-8b5a-b075bbf38bb6 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:54:26.703723 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42cb4-cc28-4481-8b5a-b075bbf38bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:54:26.723628 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-f4d42cb4-cc28-4481-8b5a-b075bbf38bb6 None None] MFA Rules not processed for user `88956186c94d4b0a8d8de99d6bd24ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:54:26.724835 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-f4d42cb4-cc28-4481-8b5a-b075bbf38bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:54:26.732384 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 614/1231] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:54:26 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:54:28.732341 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa763-2f97-438d-8bcb-cf6dd28b2254 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:54:28.761137 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa763-2f97-438d-8bcb-cf6dd28b2254 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:54:28.766014 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316e9b2-08c3-4210-9379-20a63facd0e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87520f22c3e944b4912d94c52e6ce84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:54:28.766696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e9b2-08c3-4210-9379-20a63facd0e6 service placement] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:54:28.766972 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e9b2-08c3-4210-9379-20a63facd0e6 service placement] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:54:28.767244 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e9b2-08c3-4210-9379-20a63facd0e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:54:28.775609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316e9b2-08c3-4210-9379-20a63facd0e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:54:28.777232 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316e9b2-08c3-4210-9379-20a63facd0e6 service placement] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:54:28.786686 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 618/1232] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:54:28 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:54:36.718752 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:54:38.782818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=13 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:55:48.842080 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523fee0-635d-476d-8615-a8fbac14d1d2 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:55:48.843721 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523fee0-635d-476d-8615-a8fbac14d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:55:48.843721 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523fee0-635d-476d-8615-a8fbac14d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:55:48.868746 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-e523fee0-635d-476d-8615-a8fbac14d1d2 None None] MFA Rules not processed for user `88956186c94d4b0a8d8de99d6bd24ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:55:48.870809 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-e523fee0-635d-476d-8615-a8fbac14d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:55:48.878442 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 615/1233] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:55:48 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:55:58.857749 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:56:03.620256 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316e9b2-08c3-4210-9379-20a63facd0e6 service placement] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:56:03.630527 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316e9b2-08c3-4210-9379-20a63facd0e6 service placement] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:56:03.634750 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbfd14-c010-42d2-bf48-f10b79b82db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:56:03.635404 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbfd14-c010-42d2-bf48-f10b79b82db1 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:56:03.635766 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbfd14-c010-42d2-bf48-f10b79b82db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:56:03.636116 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbfd14-c010-42d2-bf48-f10b79b82db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:56:03.652343 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbfd14-c010-42d2-bf48-f10b79b82db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:56:03.653827 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbfd14-c010-42d2-bf48-f10b79b82db1 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:56:03.664176 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 619/1234] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:56:03 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:56:09.718952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de71a-24a8-4120-93a5-69ed2a481c2b None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:56:09.719461 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de71a-24a8-4120-93a5-69ed2a481c2b None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:56:09.719554 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de71a-24a8-4120-93a5-69ed2a481c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:56:09.738580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-bc2de71a-24a8-4120-93a5-69ed2a481c2b None None] MFA Rules not processed for user `a86e12c3821d4ec59d69bb98c65a7694`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:56:09.739781 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-bc2de71a-24a8-4120-93a5-69ed2a481c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:56:09.747602 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 616/1235] 10.222.0.67 () {58 vars in 958 bytes} [Mon Jul 25 09:56:09 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:56:13.659839 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=6 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:56:19.733249 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=3 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:56:26.642163 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbfd14-c010-42d2-bf48-f10b79b82db1 service neutron] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:56:26.663033 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbfd14-c010-42d2-bf48-f10b79b82db1 service neutron] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:56:26.669026 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8dc64-8033-4179-930a-a077f218003f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:56:26.669671 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8dc64-8033-4179-930a-a077f218003f service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:56:26.669962 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8dc64-8033-4179-930a-a077f218003f service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:56:26.670282 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8dc64-8033-4179-930a-a077f218003f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:56:26.678959 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8dc64-8033-4179-930a-a077f218003f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:56:26.680563 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8dc64-8033-4179-930a-a077f218003f service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:56:26.691895 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 620/1236] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:56:26 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:56:36.686884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=10 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:56:39.087419 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de71a-24a8-4120-93a5-69ed2a481c2b None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:56:39.097347 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de71a-24a8-4120-93a5-69ed2a481c2b None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:56:39.100938 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a70fc-9e02-4e72-a306-cb7365be8492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:56:39.101633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a70fc-9e02-4e72-a306-cb7365be8492 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:56:39.101921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a70fc-9e02-4e72-a306-cb7365be8492 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:56:39.102201 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a70fc-9e02-4e72-a306-cb7365be8492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:56:39.112045 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a70fc-9e02-4e72-a306-cb7365be8492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:56:39.113633 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a70fc-9e02-4e72-a306-cb7365be8492 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:56:39.124548 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 617/1237] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:56:39 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:56:49.119437 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=6 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:57:02.273071 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8dc64-8033-4179-930a-a077f218003f service nova] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:57:02.283673 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8dc64-8033-4179-930a-a077f218003f service nova] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:57:02.288602 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171250fe-fb80-417f-b007-83e411838640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:57:02.289264 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171250fe-fb80-417f-b007-83e411838640 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:57:02.289554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171250fe-fb80-417f-b007-83e411838640 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:57:02.289880 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171250fe-fb80-417f-b007-83e411838640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:57:02.304818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171250fe-fb80-417f-b007-83e411838640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:57:02.304818 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171250fe-fb80-417f-b007-83e411838640 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:57:02.308190 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 621/1238] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:57:02 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:57:03.360044 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a70fc-9e02-4e72-a306-cb7365be8492 service neutron] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:57:03.368454 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a70fc-9e02-4e72-a306-cb7365be8492 service neutron] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:57:03.372053 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c2c8e-3acd-43f7-be8f-e328819f9966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:57:03.372685 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2c8e-3acd-43f7-be8f-e328819f9966 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:57:03.372967 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2c8e-3acd-43f7-be8f-e328819f9966 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:57:03.373241 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2c8e-3acd-43f7-be8f-e328819f9966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:57:03.383135 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c2c8e-3acd-43f7-be8f-e328819f9966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:57:03.384552 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c2c8e-3acd-43f7-be8f-e328819f9966 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:57:03.395073 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 618/1239] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:57:03 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:57:12.304977 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=6 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:57:13.390163 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=6 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:57:47.231031 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171250fe-fb80-417f-b007-83e411838640 service neutron] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:57:47.260330 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171250fe-fb80-417f-b007-83e411838640 service neutron] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:57:47.273372 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1caa3-52ee-42fd-9ed8-b1a298c48d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:57:47.274183 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1caa3-52ee-42fd-9ed8-b1a298c48d23 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:57:47.274615 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1caa3-52ee-42fd-9ed8-b1a298c48d23 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:57:47.274993 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1caa3-52ee-42fd-9ed8-b1a298c48d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:57:47.290672 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1caa3-52ee-42fd-9ed8-b1a298c48d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:57:47.293512 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1caa3-52ee-42fd-9ed8-b1a298c48d23 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:57:47.311655 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 622/1240] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:57:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:57:57.303609 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=6 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:58:02.270437 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c2c8e-3acd-43f7-be8f-e328819f9966 service neutron] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:58:02.280119 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c2c8e-3acd-43f7-be8f-e328819f9966 service neutron] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:58:02.283993 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2aabe-9a33-4226-9a5d-74b3a5b6e9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:58:02.284643 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2aabe-9a33-4226-9a5d-74b3a5b6e9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:58:02.284932 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2aabe-9a33-4226-9a5d-74b3a5b6e9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:58:02.285210 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2aabe-9a33-4226-9a5d-74b3a5b6e9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:58:02.356681 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2aabe-9a33-4226-9a5d-74b3a5b6e9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:58:02.358096 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2aabe-9a33-4226-9a5d-74b3a5b6e9f4 service neutron] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:58:02.377563 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 619/1241] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:58:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:58:06.078968 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7609-c72f-4602-894c-2fab8462e8a0 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:58:06.079450 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7609-c72f-4602-894c-2fab8462e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:58:06.079805 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7609-c72f-4602-894c-2fab8462e8a0 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:58:06.081271 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 623/1242] 10.222.0.67 () {54 vars in 921 bytes} [Mon Jul 25 09:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:58:06.092939 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f0c82-ceaa-4acb-abf9-9da0858572f8 None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:58:06.093380 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f0c82-ceaa-4acb-abf9-9da0858572f8 None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:58:06.093583 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f0c82-ceaa-4acb-abf9-9da0858572f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:58:06.131339 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-a26f0c82-ceaa-4acb-abf9-9da0858572f8 None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:58:06.132480 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-a26f0c82-ceaa-4acb-abf9-9da0858572f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:58:06.142460 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 620/1243] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Jul 25 09:58:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 09:58:06.154438 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c7609-c72f-4602-894c-2fab8462e8a0 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:58:06.168200 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c7609-c72f-4602-894c-2fab8462e8a0 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:58:06.173250 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468cf64-3881-45d2-b617-d8253f8db67b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87520f22c3e944b4912d94c52e6ce84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:58:06.173888 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468cf64-3881-45d2-b617-d8253f8db67b service placement] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:58:06.174178 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468cf64-3881-45d2-b617-d8253f8db67b service placement] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:58:06.174455 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468cf64-3881-45d2-b617-d8253f8db67b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:58:06.183696 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468cf64-3881-45d2-b617-d8253f8db67b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:58:06.185347 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468cf64-3881-45d2-b617-d8253f8db67b service placement] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:58:06.194941 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 624/1244] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:58:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:58:10.177784 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f0c82-ceaa-4acb-abf9-9da0858572f8 None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:58:10.188793 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f0c82-ceaa-4acb-abf9-9da0858572f8 None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:58:10.197550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:58:10.197550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:58:10.197550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:58:10.197550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] PATH_INFO: `/v3/users/a86e12c3821d4ec59d69bb98c65a7694` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:58:10.197898 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86e12c3821d4ec59d69bb98c65a7694)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:58:10.199290 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:58:10.394926 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86e12c3821d4ec59d69bb98c65a7694'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:10.395596 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86e12c3821d4ec59d69bb98c65a7694'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:10.396192 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86e12c3821d4ec59d69bb98c65a7694'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:10.403653 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86e12c3821d4ec59d69bb98c65a7694'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:10.472368 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86e12c3821d4ec59d69bb98c65a7694'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:10.490649 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 621/1245] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Jul 25 09:58:10 2022] DELETE /identity/v3/users/a86e12c3821d4ec59d69bb98c65a7694 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:58:10.977255 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468cf64-3881-45d2-b617-d8253f8db67b service placement] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:58:10.988674 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468cf64-3881-45d2-b617-d8253f8db67b service placement] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:58:11.045878 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:58:11.046782 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:58:11.047062 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:58:11.047359 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] PATH_INFO: `/v3/projects/47498626fdb447ceaba2c0d196d14501` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:58:11.048560 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47498626fdb447ceaba2c0d196d14501)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:58:11.050477 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:58:11.175616 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47498626fdb447ceaba2c0d196d14501', 'request_id': 'req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.181924 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47498626fdb447ceaba2c0d196d14501', 'request_id': 'req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.187891 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47498626fdb447ceaba2c0d196d14501', 'request_id': 'req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.279985 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] The token cache is being invalidate because project 47498626fdb447ceaba2c0d196d14501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93888) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:58:11.280305 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.280921 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.282930 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 625/1246] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Jul 25 09:58:10 2022] DELETE /identity/v3/projects/47498626fdb447ceaba2c0d196d14501 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:58:11.286968 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:58:11.288435 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:58:11.301715 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eade4c3-917b-46c0-9cc4-a95565e094bc admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:58:11.329677 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:58:11.360573 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:58:11.361450 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:58:11.361733 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:58:11.362067 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] PATH_INFO: `/v3/users/daad05ea96aa4e83a1c5d4888623055e` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:58:11.363621 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] RBAC: Authorizing `identity:delete_user(user_id=daad05ea96aa4e83a1c5d4888623055e)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:58:11.366015 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:58:11.554360 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daad05ea96aa4e83a1c5d4888623055e'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.554952 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daad05ea96aa4e83a1c5d4888623055e'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.555580 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daad05ea96aa4e83a1c5d4888623055e'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.563560 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daad05ea96aa4e83a1c5d4888623055e'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.670896 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daad05ea96aa4e83a1c5d4888623055e'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:11.689477 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 622/1247] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Jul 25 09:58:11 2022] DELETE /identity/v3/users/daad05ea96aa4e83a1c5d4888623055e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:58:11.898760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:58:11.898760 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:58:11.905459 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc3f26-1eb2-467d-9b89-75bcf29b21e8 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:58:11.965189 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:58:11.966052 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:58:11.966342 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:58:11.966748 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] PATH_INFO: `/v3/projects/e7e494ceeaac4fd1889a019370def04b` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:58:11.967946 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e494ceeaac4fd1889a019370def04b)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:58:11.969879 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:58:11.978179 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:58:12.105994 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e494ceeaac4fd1889a019370def04b', 'request_id': 'req-96436bfb-1d99-4c51-9c09-1216bd8c9352'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:12.112192 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e494ceeaac4fd1889a019370def04b', 'request_id': 'req-96436bfb-1d99-4c51-9c09-1216bd8c9352'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:12.117721 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e494ceeaac4fd1889a019370def04b', 'request_id': 'req-96436bfb-1d99-4c51-9c09-1216bd8c9352'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:12.210554 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] The token cache is being invalidate because project e7e494ceeaac4fd1889a019370def04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93888) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:58:12.210797 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:12.211488 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-96436bfb-1d99-4c51-9c09-1216bd8c9352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:58:12.213075 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 626/1248] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Jul 25 09:58:11 2022] DELETE /identity/v3/projects/e7e494ceeaac4fd1889a019370def04b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 09:58:21.685934 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:58:22.334378 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:59:26.676991 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:26.678423 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:26.760024 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3d2d-8235-4ce2-9f90-f30dffa0572e admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:26.819728 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25105d2-b77c-4e66-9c8c-0edcf51c1b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:26.821010 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25105d2-b77c-4e66-9c8c-0edcf51c1b13 service nova] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:26.821292 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25105d2-b77c-4e66-9c8c-0edcf51c1b13 service nova] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:26.821562 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25105d2-b77c-4e66-9c8c-0edcf51c1b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:26.823373 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-b25105d2-b77c-4e66-9c8c-0edcf51c1b13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:26.880152 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25105d2-b77c-4e66-9c8c-0edcf51c1b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:26.881776 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25105d2-b77c-4e66-9c8c-0edcf51c1b13 service nova] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:26.891920 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 623/1249] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:59:26 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:59:28.803942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d901b70-03e5-40e5-839f-74a2573d03f3 None None] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:28.804518 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d901b70-03e5-40e5-839f-74a2573d03f3 None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:28.805166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d901b70-03e5-40e5-839f-74a2573d03f3 None None] PATH_INFO: `/` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:28.807174 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 627/1250] 10.222.0.67 () {54 vars in 921 bytes} [Mon Jul 25 09:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:59:28.812196 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b772bd-245d-4a86-b99f-b26348aaf9ac None None] REQUEST_METHOD: `POST` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:28.827908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b772bd-245d-4a86-b99f-b26348aaf9ac None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:28.827908 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b772bd-245d-4a86-b99f-b26348aaf9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:28.854086 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.auth.core [None req-b2b772bd-245d-4a86-b99f-b26348aaf9ac None None] MFA Rules not processed for user `3d3ad9c9521e42f783693c1c4b20cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=93887) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:59:28.855318 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-b2b772bd-245d-4a86-b99f-b26348aaf9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:28.863960 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 624/1251] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Jul 25 09:59:28 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:59:28.876869 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d901b70-03e5-40e5-839f-74a2573d03f3 None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:28.879579 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-3d901b70-03e5-40e5-839f-74a2573d03f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:28.895248 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d901b70-03e5-40e5-839f-74a2573d03f3 None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:28.900466 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d3ad9c9521e42f783693c1c4b20cadc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:28.901099 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:28.901383 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:28.901659 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:28.910692 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:28.914433 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:28.924586 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 628/1252] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:59:28 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:59:32.239897 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b772bd-245d-4a86-b99f-b26348aaf9ac None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:32.241289 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-b2b772bd-245d-4a86-b99f-b26348aaf9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:32.258878 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=100 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:59:32.321005 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b772bd-245d-4a86-b99f-b26348aaf9ac None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:32.326166 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f6285-f787-4950-b523-7581aae807c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87520f22c3e944b4912d94c52e6ce84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:32.327069 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f6285-f787-4950-b523-7581aae807c9 service placement] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:32.327778 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f6285-f787-4950-b523-7581aae807c9 service placement] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:32.328068 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f6285-f787-4950-b523-7581aae807c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:32.329903 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-5f9f6285-f787-4950-b523-7581aae807c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:32.342187 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f6285-f787-4950-b523-7581aae807c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:32.343826 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f6285-f787-4950-b523-7581aae807c9 service placement] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:32.354243 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 625/1253] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:59:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:59:38.920261 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=6 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:59:41.773659 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:41.775286 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:41.852291 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de318d-c99a-4ee0-9834-a30fcb5eb711 service nova] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:41.856220 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f430f-ae5e-4252-aaec-4c6603615c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3969b99ab3b9410388d56dda5a4e15e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:41.856875 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f430f-ae5e-4252-aaec-4c6603615c29 service neutron] REQUEST_METHOD: `GET` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:41.857166 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f430f-ae5e-4252-aaec-4c6603615c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:41.857472 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f430f-ae5e-4252-aaec-4c6603615c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:41.859323 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-588f430f-ae5e-4252-aaec-4c6603615c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:41.927712 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f430f-ae5e-4252-aaec-4c6603615c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:41.929090 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f430f-ae5e-4252-aaec-4c6603615c29 service neutron] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:41.940206 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 629/1254] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:59:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:59:42.349443 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=31 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:59:45.331950 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7617-d169-4176-8969-e75c4f75a6ea None None] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:45.332603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7617-d169-4176-8969-e75c4f75a6ea None None] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:45.332603 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7617-d169-4176-8969-e75c4f75a6ea None None] PATH_INFO: `/` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:45.336082 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 626/1255] 10.222.0.67 () {54 vars in 921 bytes} [Mon Jul 25 09:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 09:59:45.363872 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1426-19a4-49e8-9eec-f29007bc982b None None] REQUEST_METHOD: `POST` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:45.364374 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1426-19a4-49e8-9eec-f29007bc982b None None] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:45.364471 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1426-19a4-49e8-9eec-f29007bc982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:45.384697 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.auth.core [None req-ac4e1426-19a4-49e8-9eec-f29007bc982b None None] MFA Rules not processed for user `87520f22c3e944b4912d94c52e6ce84e`. Rule list: `[]` (Enabled: `True`). {{(pid=93888) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 09:59:45.386399 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-ac4e1426-19a4-49e8-9eec-f29007bc982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:45.395183 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 630/1256] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Jul 25 09:59:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 09:59:45.406418 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a7617-d169-4176-8969-e75c4f75a6ea None None] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:45.408235 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-a63a7617-d169-4176-8969-e75c4f75a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:45.425151 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a7617-d169-4176-8969-e75c4f75a6ea None None] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:45.430189 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158ab78-127d-4630-ba24-aeda569e4dbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87520f22c3e944b4912d94c52e6ce84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cba6578d329149e1b0d2b8c7714d275b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:45.431255 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158ab78-127d-4630-ba24-aeda569e4dbb service placement] REQUEST_METHOD: `GET` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:45.431550 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158ab78-127d-4630-ba24-aeda569e4dbb service placement] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:45.431853 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158ab78-127d-4630-ba24-aeda569e4dbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:45.440709 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158ab78-127d-4630-ba24-aeda569e4dbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:45.442280 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158ab78-127d-4630-ba24-aeda569e4dbb service placement] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:45.452816 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 627/1257] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Jul 25 09:59:45 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 09:59:48.808467 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1426-19a4-49e8-9eec-f29007bc982b None None] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:48.813705 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-ac4e1426-19a4-49e8-9eec-f29007bc982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:48.823491 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1426-19a4-49e8-9eec-f29007bc982b None None] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:48.828125 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:48.829041 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:48.829327 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:48.829603 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] PATH_INFO: `/v3/users/88956186c94d4b0a8d8de99d6bd24ccd` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:48.830860 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88956186c94d4b0a8d8de99d6bd24ccd)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:48.831883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: WARNING py.warnings [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:59:48.831883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: warnings.warn(msg) Jul 25 09:59:48.831883 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: Jul 25 09:59:48.833084 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:49.035884 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88956186c94d4b0a8d8de99d6bd24ccd'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.046526 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88956186c94d4b0a8d8de99d6bd24ccd'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.047203 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88956186c94d4b0a8d8de99d6bd24ccd'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.127543 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88956186c94d4b0a8d8de99d6bd24ccd'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.146301 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88956186c94d4b0a8d8de99d6bd24ccd'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.153055 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 631/1258] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Jul 25 09:59:48 2022] DELETE /identity/v3/users/88956186c94d4b0a8d8de99d6bd24ccd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:59:49.371810 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158ab78-127d-4630-ba24-aeda569e4dbb service placement] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:49.384388 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158ab78-127d-4630-ba24-aeda569e4dbb service placement] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:49.442663 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:49.443530 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:49.443818 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:49.444099 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] PATH_INFO: `/v3/projects/7fbf72e6f60d4aca85f3929f35afb868` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:49.445343 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbf72e6f60d4aca85f3929f35afb868)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:49.446361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: WARNING py.warnings [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 09:59:49.446361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: warnings.warn(msg) Jul 25 09:59:49.446361 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: Jul 25 09:59:49.448195 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:49.602750 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbf72e6f60d4aca85f3929f35afb868', 'request_id': 'req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.616453 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbf72e6f60d4aca85f3929f35afb868', 'request_id': 'req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.623131 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbf72e6f60d4aca85f3929f35afb868', 'request_id': 'req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.698635 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] The token cache is being invalidate because project 7fbf72e6f60d4aca85f3929f35afb868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93887) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:59:49.698921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.699548 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:49.701153 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 628/1259] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Jul 25 09:59:49 2022] DELETE /identity/v3/projects/7fbf72e6f60d4aca85f3929f35afb868 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:59:49.705149 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] Authenticating user token {{(pid=93888) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:49.706665 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.fernet_utils [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93888) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:49.716052 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:59:49.719738 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49268b-beb2-4c13-93ba-56caeee240e4 admin admin] Validating token access rules against request {{(pid=93888) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:49.777445 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93888) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:49.778333 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:49.778663 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:49.778943 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] PATH_INFO: `/v3/users/613e2d60fd504b239e063b444bb765c5` {{(pid=93888) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:49.780144 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=613e2d60fd504b239e063b444bb765c5)` {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:49.782101 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] RBAC: Authorization granted {{(pid=93888) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:50.035644 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613e2d60fd504b239e063b444bb765c5'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.043188 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613e2d60fd504b239e063b444bb765c5'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.043873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613e2d60fd504b239e063b444bb765c5'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.098942 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613e2d60fd504b239e063b444bb765c5'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.111867 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG keystone.notifications [None req-34a1ca92-6e23-4e8b-9e44-980f3a2ceb8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613e2d60fd504b239e063b444bb765c5'} {{(pid=93888) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.117873 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: [pid: 93888|app: 0|req: 632/1260] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Jul 25 09:59:49 2022] DELETE /identity/v3/users/613e2d60fd504b239e063b444bb765c5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 09:59:50.373665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] Authenticating user token {{(pid=93887) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 09:59:50.375156 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.fernet_utils [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93887) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 09:59:50.390238 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c47d6-ff59-4cef-b1a9-cffcf1e32d5a admin admin] Validating token access rules against request {{(pid=93887) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 09:59:50.450767 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2c0cf22337e45c78e8cb5635c37dbcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81ad3fb6bc2540d4880f089b3fb44ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93887) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 09:59:50.451636 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 09:59:50.451923 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] SCRIPT_NAME: `/identity` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 09:59:50.452199 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] PATH_INFO: `/v3/projects/a0dc33ddc9084144a285da90a6ba87af` {{(pid=93887) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 09:59:50.453366 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0dc33ddc9084144a285da90a6ba87af)` {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 09:59:50.455317 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] RBAC: Authorization granted {{(pid=93887) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 09:59:50.477984 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 09:59:50.560164 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0dc33ddc9084144a285da90a6ba87af', 'request_id': 'req-62145e4b-4674-4ea5-88c3-4ec27f40809b'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.566911 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0dc33ddc9084144a285da90a6ba87af', 'request_id': 'req-62145e4b-4674-4ea5-88c3-4ec27f40809b'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.573816 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0dc33ddc9084144a285da90a6ba87af', 'request_id': 'req-62145e4b-4674-4ea5-88c3-4ec27f40809b'} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.675451 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] The token cache is being invalidate because project a0dc33ddc9084144a285da90a6ba87af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93887) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 09:59:50.675742 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.676368 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG keystone.notifications [None req-62145e4b-4674-4ea5-88c3-4ec27f40809b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93887) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 09:59:50.677921 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: [pid: 93887|app: 0|req: 629/1261] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Jul 25 09:59:50 2022] DELETE /identity/v3/projects/a0dc33ddc9084144a285da90a6ba87af => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 10:00:00.114201 dv-osbrick-709432-11-ceph devstack@keystone.service[93888]: DEBUG dbcounter [-] [93888] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 10:00:00.739665 dv-osbrick-709432-11-ceph devstack@keystone.service[93887]: DEBUG dbcounter [-] [93887] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}